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The Mathematics Improvement Component (MIC) war, first 
implemented in the Columbus (Ohio) Public Schools in 1987-88 to 
assist elementary and middle school pupils who were low achievers in 
mathematics. Three programs comprised the 1989-90 MIC: the Elementary 
Computer Assisted Instruction (Elem-CAI) Program, the Elementary 
Competency Based Education (Elem-CBE) Program, and the Middle School 
Competency Based Education (Middle-CBE) Program. In the first 
program, selected students were served an average of three tim^s per 
week in computer-assisted instruction (CAI) labs, «nd classroom 
teachers delivered additional individual* and small-group instruction. 
In both MIC-CBE programs, selected pupils were administered tests 
periodically that provided objective-based mastery information 
related to the Columbus district's course of study. All three hIC 
programs included ongoing diagnosis of mathematics difficulties and 
assessment of pupil progress based on the cooperative efforts of the 
program teachers and the classroom teachers. The three programs 
combined to serve 2,050 students in 31 elementary schools and 12 
middle schoo3s with the assistance of 44 teachers. (Besides the pupil 
census information, this report contains the following: standardized 
achievement test results; potential retainee/course failure 
information; and appendixes which include parental involvement 
surveys , inservice evaluation quest ionnaires, computer census 
tallies, and the process evaluation logs that were compiled by 
supervisors. ) ( JJK) 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
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tlementaiv and Seconriarv * ducat ion Act - Chapter I 

FINAL VALUATION REPORT 
'ftlKEMAXICS rtPSDVESOir OOMPONSir: 
ELEMENTARY (JMPUTER ASSISTED INSTRUCTION PROGRAM, ELEJ^OTARY (^IPEXEJCY 
^ASED EDUCATION PROGRAM, AMD MIDDLE SCH30L COMPETENCY BASED EDUCATION PROGRAM 

ABSTRACT 

Program Descriptions : The Mathematics Liprovetaent Coaponeat OitC) served 2,050 oupiis, with a goal to 
inprove che skills and achievement Id wis of oupiis who were law achievers In mathematics* Three 
^rogranB comprised MIC: the Elementary Conputar \s sis ted Instruction Program, the Elementary Conpetencv 
3ased education Program, and the Middle School CcnDetency Bassfd Education Program. In the first program, 
selected pupils were served in conwitet^assisr^o-instruccton (CAI) labs* The IHC-CAI program teachers 
provided Individual and small-group Instruction in addition to drill and practice sessions on the 
confute r\ In the MIC-CBE programs, selected pupil? were administered tests periodically which provided 
objective based mastery information related to tte districts' Course of Study * \t tha elementary level, 
pupils were served an average of three tiroes .1 -Jeek, while at the middle school level, pupils were serwd 
an average of two ttates a week* In all programs selected pupils were permitted to move ? \ and out of the 
nrograra as needed during the school year. 

l n 1939-90 the MIC programs were Lrar, iemented bv 44 teachers in a total of 43 schools— 31 elementatv 
schools and 12 middle schools. The toC-CAI program served a total of 20 elementary schools. The MIC-CBE 
program served a total of 23 schools, 11 at the elementary level and 12 at the middle school level* 

Tim Intervals : For evaluation purposes the MIC programs started on September 18, !W and continued 
through ! larch 30, 1990, This interval of time gave 126 days of possible program instruction* Students 
Included In the cirvl pretest-posttast analyses rust have been enrolled at least 30 days and attended the 
program at least 80S of their instructional period* The rumber of enrollment days and instructional days 
varied from pupil to pupil* 

Activities: Inplen^ntation of the MIC programs was acconpltshed through instructional activities to 
strengthen and extend regular classroom instruction* Instructional techniques and materials based on 
skill-centered objectives and coordinated with :he Columbus Course of Study (O0S) objectives were 
designed to fit individual pupil needs* 

Desired Outcongs : Both MIC-CAI and MIC-CBE programs shared three desired outcomes* ^sired Outccws 1 
and 2 were evaluated by achievement testing which measured pupil performance in mathematics skills* The 
two achievement ourcomes required that at least 50 percent of the pupils in the samples — those who met 
the attendance criterion, were English speaking, and had a pretest-pesttest score for Total Mathematics 
or a pretest-posttest score fcr Mathematics Concepts and Applications— would gain at least 3*0 normal 
curve equivalent points cor the instructional period in each program. Desired Outcome 3 stated that at 
least 35% of the pupils who were enrolled at least 30 days and attended the program at least 80S of their 
instructional period and who were identified as being in danger of being retained/f3tied would not be 
re tained/f ailed* 

Evaluation Design : The two desired outcomes dealing with gain in NC£ points were evaluated through the 
administration of the Comprehensive Tests of Basic Skills (CTBS, 1981) at grades 3-8* Analyses of the 
pretest to posttest data were primarily in terns of NCE change scores and percentages of pupils by grade 
and by evaluation sanples meeting criterion for the NCE point g^in of 3*0 The other desired outcome was 
evaluated by means of a locally constructed instrument. 

Ma jor Findings : Major findings are presented separately for the 'CLC-CAI and MIC-CBE programs* 

HC-CAI program* Analyses of pupil census data indicated a total of 697 pupils in grade 3-5 were 
served by the 22 half-tine MtC-CAI teachers* The average number of MIC-CAI p<tpils served during the 
school year per teacher was 31. 7^ The average number of MIC-CAI pupils enrolled per teacher on any given 
day was 22.0. The average amount of instruction per week was 3*1 hours. The average hours of 
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instruction per week, varied only slightly from grade level to grade level and ranged fro© 3.0 to 3.1 
hours* 

The evaluation sample for Total Mathematics consisted of 522 pupils in grades 3-5. Analyses of the Total 
Mntematics scores indicated an average change of 10.5 VCE points. Results exceeded the ^valuation 
crit fon for mtharatics growth of 3,0 NCE points specified in Desired Outcome 1. The evaluation sarole 
for v lathematics Concepts and Applications consisted of 517 pupils in grades 3-5. \naiyses of the 
Mathematics Concepts and Applications scores irriicated an average change of 5.7 ^CE points. Results 
exceeded the evaluation criterion for mathematics growth of 3.0 NCE points specified in Desired Outcome 



"arly in the school year, teachers identified 82 (14.6%) pupils of the 560 program pupils listed, as 
being potential retainees. \t the end of the school year, 69 of the 82 (94.1%) pupils identified, *ere 
not retained in grade, f3r exceeding the criterion of 35.0% specified in Oesired Outcome 3« Positive 
ratings were given by MIO-CAI teachers to Chapter 1 tnservtoe sessions in which they participated. 
Overall ratings for q " stions ^angad from 4.6 to 4.7 on a scale of 1.0 (Strongly Disagree) to 5.0 
(Strongly Agree). MIC-CAl teachers reported contact with parents and hoars spent in five different 
activities at the end of each nxxith. They reported a total of 1311.^ contacts with 435 oarents of 
program pupils involving 831.0 parent hours. 

Process evaluation, including on-site visitations to 11 of 22 MiC-CAI labs indicated that the areas of 
Parent Involvement and Testing received lower average ratings by teachers than such areas as Class 
Scheduling and Materials Provided for Program. The MIC-CAI teachers also gave consistently high ratings 
to the area of Facilities. In addition, a questionnaire surveying carrjxiter systems used in MIC-CM labs 
showed that pupils worked at their conputer stations an average of 45.4% of their instructional time. 

MIC-CBS program. Analyses of pupil census data indicated a total of 1353 pupils in grades 3-9 were 
served in the 11 e lenient ary schools and 12 middle schools In the MIC-CBE program. Of the 1353 pun Is, 
522 were In elementary schools and 831 were in middle schools. The average number of pupils served 
during the school year per teacher was 61.5. The average number of pupils enrolled per teacher on any 
given day was 23.6. The average amount of instruction per week was 1.7 hours. The average hours of 
instruction per week varied by grade level and ranged from 1.5 hoars for grades 6-8, to 2.2 hairs for 
grade 4. 

The evaluation sample for Total Matheajatics consisted of 585 pupils in grades 3-8. Analyses of the Total 
Mathematics scores indicated an average change of 11.0 VCE points. Results exceeded the evaluation 
criterion for ratheraatics growth of 3.0 NCE points specified in Oesired Outcome i. The evaluation sample 
for Ma theoretics Concepts and Applications consisted of 534 pupils in grades 3-8. \nalyses of the 
'Mathematics Concepts and Applications scores indicated an average change of 7.4 Nt£ points. Results 
exceeded the evaluation criterion tor mathematics growth of 3.0 NCE points specified in Desired Outcome 
2. 

^arly in the school year, teachers identified 189 pupils or 29.6% of the 638 program pupils listed, as 
being potential retainers/course failures. Kt the end of the school year, 130 of the 139 pupils 
identified, or 68.8%, were not retained in grade or failed, far exceeding the criterion of 35.0% 
specified in Oesired Outcome 3. Positive ratings were given by MIC-CBE teachers to Chapter 1 inservice 
sessions in 'which they participated* Overall ratings for questions *anged from 4.6 to 4.3 on a scale of 
U0 (Strongly Disagree) to 5.0 (Strongly Agree). NffC-CEE teachers reported a total of 1651 contacts with 
739 parents of pro g ra m pupils involving 940.5 parent hours. 

Process evaluation, including oir-site visitations to 20 of 22 MIC-Cffi labs, indicated that, similar to 
the HXC-CVI teachers, the areas of Parent Involvement and Testing received lower average ratings by 
teachers than such areas as Class Scheduling and Materials Provided for Program. Hew&ver, !ttO*CEE 
teachers gave lower ratings to the area Facilities than did the MKM2AI teachers. 

^ eoocanendatlons ; Programs to improve mathematics skills should be cou^nued with additional efforts mde 
to improw uoon the shortcomings of the present and previous programs. 
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MIDDLE SCHOOL COMPETENCY BASED EDUCATION PROGRAM 

December 1990 



Program Descriptions 

The Mathematics Improvement Component (MIC) vas first implemented in the 
Columbus Public Schools in 1987-8S to assist elementary and middle school pupils 
who were low achievers in mathematics. In 1989-90 MIC was in its third year of 
operation. The overall mirpose o f . MIC was to improve the mathematics skills and 
levels of achievement of pupils selected for service in priority schools. 

Funding for MIC ^as provided bv Chapter 1 of the Elementary and Secondary 
Education Act (ESEA). "rior Co MIC, the Basic Math Improvement Program (BMIP) 
operated in the Columbus Public Schools from I M co 1982 ^ith funding from Title 
I of the Elementary and Secondary Education Act. 

Three programs comprised the 1989-90 Mathematics Improvement Component: the 
Elementary Computer Assisted Instruction (Elem-CAI) Program, the Elementary 
Competency Based Education (Elero-CBE) Program, and the Middle School Competency 
Based Education (Middle-CSE) Program. In the first program, selected pupils were 
served an average of three limes a week in computer-assisted- instruct ion (CAI) 
labs. The MIC-CAI program teachers delivered individual and small-group 
instruction in addition to drill and practice sessions on the computers. In the 
MIC-CBE programs, selected pupils were administered tests periodically which 
provided objective based mastery information related to the district's Course of 
Study. At the elementary level, pupils were served an average of three times a 
week, while at the middle school level, pupils were .served an average of two 
times a week. In both the MIC-CAI and MIC-CBE programs, selected pupils were 
allowed to move in and out of the program as needed during the school vear. 

Ail three MIC programs Included ongoing diagnosis of mathematics problems and 
assessment of pupil orogress based on the cooperative efforts of the program 
teacher and the classroom teacher. Program planning was accomplished in 
cooperation with the mathematics personnel of the school district. Instruction 
was coordinated with the pupil's regular classroom teacher ind the Columbus 
Course of Study (COS). The MIC teachers received support from a full-time 
program coordinator and inservice meetings. 

In 1989-90 the MIC programs were located in a total of l -*5 schools— 31 
elementary schools and 12 middle schools. Of these, the MIC-CAI program served a 
total of 20 elementary schools. The MIC-CBE program served a total of 23 
schools, I I at the elementary level and 12 at the middle school level. 

In this report the two Competency Based Education programs (MIC-CBE) 
generally are treated is one and are discussed separately from the MIC-CAI 
program. However, the MIC programs are treated as a whole for the purpose of 
discussing certain features that are common to all three programs (e.g., aspects 
of the evaluation design). The MIC programs are described in more detail below. 
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Eleraentary Computer-Assisted Instruction Program (MlC-CAl) 

Each MIC-CAI program teacher was located In a coraputer-asslsted-instruction 
(CAI) lab equipped *lth ilcrocomputers or minicomputers. The teacher vas 
provided instructional materials, software, and a computer-management system. ^n 
Instructional aide generally was assigned to each elementary lab. Instruction 
was individualized to meet :he needs of each pupil. 

The lab was used aooro*iraately a half-day each for the MIC-CAI program and 
the Compensatory Language ^*periences and Reading (CLEAR -CAI ) program. The 
teacher served half-time In each program. Evaluation of the CLEAR-CAI program is 
available in a separate report (Lore & Chamberlain, 1990). 

Selected pupils normally received instruction tn groups of eight to 10 for at 
least three 40- minute periods of instruction every five school days for the 
entire school year. According to the program guidelines, pupils could not be 
pulled from the regular classroom during reading or mathematics classes* 
Scheduling arrangements varied from school to school, however. About half of the 
teachers, for example, provided instruction for pupils each day of the week. 

In 1989-*') the MtC-CU urogram served selected pupils In grides 3-5 in * 
total of 20 buildings. Program staff consisted of 22 teachers. With the 
exception of two elementary schools, each building was staffed by one program 
teacher. Two elementary schools were each staffed by two program teachers. 

Competency Based Education Program (MIC-CBE) 

A key feature of both the MIC-CAI and the MIC-CBE programs uas the 
flexibility to move selected pupils in and out of the program as needed during 
the year. Meed was determined by pupil performance on formative tests 
administered at the end of each chapter by the classroom teacher. The tests were 
designed by a team of classroom teachers to reflect the textbook and the Columbus 
Course of Study CCOS) objectives. Intervention followed the formative 
assessment- After pupils received Instruction they were retested periodically on 
the COS objectives that vere not mastered on the classroom chanter test. 

According to the program guidelines, pupils were to receive instruction in 
groups of 6 for at least three iO-ntinute classes every five school days at the 
elementary level and group* of six for at least two 40-mlnute classes every five 
school days at the middle school level. Approximately 36 students could be 
served during the six periods per day by each MIC-Elem-CBE teacher, and 
approximately 30 students could be served during the five periods per day by each 
MlC-Mlddle CBE teacher. In a few schools the service delivery pattern varied 
slightly from the norm. 

In 1989-90 the MIC-CBE program served selected pupils In grades 3-8 In a 
total of 23 schools, 11 at the elementary level and 12 at the middle school 
level. Program staff consisted of 22 teachers, 10 at the elementary level and 12 
at the middle school level. 
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Evaluation Objectives 

The desired outcomes for bof.h the MIC-CAI and MIC-CBE programs *ere as 
follows: 

kt lease 50Z of the pupils who w«re .-moiled at least 30 davs and who 
attended the orograra at least 30% of their Instructional period will gain at 
least 3.0 normal curve equivalent (MCE) points for the Instruct lonal period 
l~i total mathematics. ~aln will be measured by a national!;' -standardized 
achievement test of mathematics. 

U least 50% of the pupils who were enrolled at l«ast 30 days 3nd who 
attended the orogram at least 80* of their Instructional period will gain at 
'.east 3.0 normal curve equivalent (NCE) points for the instructional period 
In mathematical concepts and applications. Oaln will be measured by u 
nationally standardized te9t. 

At least 35% of the pupils who were enrolled at least 30 'lays ind who 
attended the program at least 30% of their Instructional period and who are 
identified by their classroom teacher on or before December !, 1989 as being 
ii danger of' being retained will not be retained (grades 3-5) or as being in 
danger of failing the course in which mathematics instruction occurs will not 
'all (grades fi-S). 

The program time period established for evaluation purposes for the MIC 
programs was 12b school days beginning September IS, 1989, and ending March 30, 
1990. For the MIC programs, analysis of pretest-posttest performance was 
contingent on pupil enrollment for a minimum of 30 days and pupil attendance for 
at least 30% of their instructional days. Days of enrollment in the MIC programs 
were counted from the day after the f* rst chapter test was given to qualify the 
pupil through the day of the chapter test indicating the pupil no longer needed 
treatment. Some MIC pupils may have had more than one enrollment oerlod. The 
number af enrollment days and instructional days varied from oupii to pupil in 
the MIC programs. 




Evaluation Design 

The evaluation design for the MIC programs provided for the collection of 
data Ln five .areas. Also, data were collected in two additional areas, computer 
usage in the MIC-CAI program and a process evaluation conducted in both the 
MIC-C.U and MIC-CBE labs. The instruments used to collect the data are found in 
Appendix A, with the exception of the standardized achievement tests. 

1. tSEA Chapter i Pupil Census Information 

A locally-developed Pupil Census form (PCF) was completed by program 
teachers for each pupil served to provide the following information: 
days of program enrollment, days of program attendance, and hours of 
Instruction per week. The form also Included Information regarding the 
pupil's grade and sex, whether or not the pupil was non-English speaking, 
and whether or not the pupil left the ESEA Chapter 1 program because he 
or she qualified for a special education program. Uso included was a 
question regarding the pupil's progress which required a subjective 
response from the program teacher. Collection of ^CFs was completed in 
April 1990. See page 37, Appendix A, for a samole ^CF. 



PVALSRVCS (?5 14 /RPTFMIC90 



4 



2. Standardised Achievement Test Information 

Program pupils were administered the two mathematics tests of the 
Comprehensive Tests of Basic Skills (CTBS, 1981). The two tests, 
Mathematics Computation and Mathematics Concepts and Applications, also 
yield a combined score for Total Mathematics. This test series, which Is 
published by CTB /McGraw-Hill, has empirical norms for fall and spring, 
established October 6-10, 1980, and April 27 to May I, 1981, 
respectively. For evaluation purposes scores Prom the two tests, 
Mathematics Concepts and Applications and Total Mathematics, were used. 
A Spring to Spring testing schedule was employed, with the pretest 
administered April 3-14, 1989, and the posttest administered March 
26-April 10» 1990. The levels and forms of the test used for each grade 
level, for both the pretest and the posttest, for pupils not retained are 
summarized In Table I • 



Table t 

CTBS Test Levels and Forms 
by Grade Level 



Pretest, 


Spring 


1989 


Posttest 


, Spring 


1990 


Grade 


Leve 1 


Form 


Grade 


Level 


Form 


2 


D* 


V* 


3 


E 


V 


3 


E 


V 


4 


F 


V 


4 


F* 


V* 


5 


G 


V 


5 


G 


V 


6 


G 


V 


6 


G 


V 


7 


H* 


V* 


t 


H* 


V* 


8 


H 


V 



♦Customized '.ests of Mathematics provided estimates of performance on this 
CTBS test. 

Ml testing was done on level. Customized tests that provided 
norm-refere.iced as well as criterion-referenced scores were administered 
at grades 2, 4 t and 7 for the pretest, and at grade 7 for the posttest. 
The customized tests were developed by Columbus Public Schools personnel 
in cooperation with CTB /McGraw-Hill to achieve a closer correlation with 
the Columbus Public Schools' Graded Course of Study, (COS). Both pretest 
and posttest were administered by classroom teachers, with program 
teachers serving as proctors, as part of the Dlstrlctwlde Testing 
Program. 

3. Potential Retalnee/Course Failure Information 

The locally developed Potential detainee Record Sheet was designed to 
Identify elementary schoc' pupils in danger of being retained for this 
school year. Information concerning possible retention was collected by 
program teachers from the pupils* regular classroom teachers and recorded 
on the Instrument by December l, 1989. At the end of the school year, 
this Information was compared with retalnee data from district computer 
flies. 
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The localiv developed Potential Course Failure Record Sheet was designed 
to Identify middle school pupils In danger of falling a mathematics 
course. ^formation concerning possible course failure was collected bv 
program teachers from the ouplls* subject area (mathematics) teacher and 
recorded on Che Instrument by December I, 1989. At the end of the school 
year, this Information vas compared vith course failure ata f rora 
district computer files. 



4. Parent Involvement Information 

The Parent Involvement Survey was constructed loca'ly to collect data on 
the nature and level of parent Involvement In ESEA Chapter 1 programs. 
Program teachers reported data on a monthly basis, September 1989 through 
June 1990, md at the end of the school year. Monthly data included the 
number of program parents Involved In five categories of parent 
Involvement, the total number of hours Chat program parents were 
Involved, and a monthly undupllcated count of the number of program 
parents involved. End-of-school-year data Included an annual 
undupllcated count of Che number of program parents involved, an estimate 
of the number of nonorogram parents involved tn the five categories of 
parent involvement, and the total number of hours that nonprogram parents 
were Involved. * copy of Che Parent Involvement Survey can be found on 
pages 38-39 of \ppendlx A. 

S. Inservlce Evaluation Information 

The locally-developed General Inservlce Evaluation Form was designed to 
obtain Che teacher's perceptions regarding the effectiveness of each 
inservlce meeting and Co provide feedback to program administrators. The 
form was distributed to participants at the close of Inservlce sessions 
held for Chapter 1 staff members. \ modified version of the form, 
located on sages 40-41, Appendix A, was used for the Opening Conference 
for Chapter t teachers during September 1989. Dates and topics of Che 
Chapter 1 Inservlce meetings for MIC teachers are shown in Table 
Teachers completed the Inservlce evaluation forms for all of the 
Inservlce -seetlnss. A. copy of the General Inservlce Evaluation Form can 
be found on page 42 of Appendix A. 

Teachers jointly serving In a MIC-CAl (mathematics) program and a 
CLEAR-CAl f reading) program particlpcted In other Chapter I inservlce 
meetings pertaining to reading, computers, and related topics. Dates and 
topics of these sessions are not Included In this report but 3re 
contained in the final evaluation report for the CLEAR Program (Lore & 
Chamberlain, 1990). 

MIC-CBE teachers participated In other Inservlce activities that were 
Informal planning meetings and/or work sessions conducted by the program 
coordinator. These meetings were not evaluated by the Department of 
Program Evaluation. 

6. Computer Census Information 

In addition to the five kinds of data specified in the evaluation design, 
Information on computer usage waa obtained for the MIC-CAt programs. The 
locally-constructed questionnaire, informally referred to as the Computer 
Censua Form, served two purposes: to delineate and describe the various 
q computer systems used in all CAl labs, and to determine the percent of 
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Table 2 



Program Teacher Participation In MIC Inservlce Meetings 

by Date and Topic 
1989-90 



Date 



Title of Inservlce 



Elementary 
MIC-CAI 



Program 



Elementary 
School 
MIC-CBE 



Middle 
School 

mic-cb: 



August 31 

September I 

September 6 
September 13 



September 23 
(A.M.) 

September 28 
(P.M.) 

November 7-10 



May 21 



Orientation for the 
1989-90 School Year 

Orientation for the 
1989-90 School Year 

Patterns of Scheduling 

Orientation for the 
1989-90 School Year 
(New Teachers) 

Using Manlpulatlves and 
Cooperative Learning 

Using the Instructional 
Management System 

Using the Instructional 
Management System 

MIC Sharing and 
Evaluation 



X 
X 



X 



Total 
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program time that pupils worked at the computers In the different 
computer systems. Data collected from this Instrument have been 
summarized In an Interim evaluation report (Chamberlain, 1990). Portions 
of the data pertaining to the KIC-CAt programs are also Included In this 
report. A copy of the Computer Census Form can be found on page 43 of 
Appendix A. 

7. Process Evaluation Information 

In addition to the types of data specified In the evaluation design a 
process evaluation was conducted, using a locally developed Instrument, 
the Evaluator's Visitation Log. On-site visits to program schools were 
carried out. During the visitations classroom observations were 
conducted, teachers were Interviewed, and questionnaire data were 
reviewed. A copy of the Instrument Is located In Appendix A, pages 44 to 
51, and the results are summarized briefly in this report. The full 
Interim report Is on file at the Department of Program Evaluation and Is 
available upon request. 
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Major Findings 
MIC Computer Assisted Instruction Program (MIC-CA1) 

Pupils were selected for the MIC-CAI programs on the basis of previous 
achievement test scores which indicated they were achieving at or below the 36th 
percentile in mathematics skills* evaluation results are summarized as follows: 

Pupil Census Information * During the 1989-90 school year the :iIC-CAl 
programs served a total of 697 pupils in grades 3-5* Of the 697 pupils t 174 were 
in the third grade. 285 were in the fourth grade, and 238 were in the fifth 
grade. 

Overall t the average number of hours of instruction per pupil per week was 
3.1 hours. The average hours of instruction varied by grade level and ranged 
from 3.0 hours for grade 3, to 3.1 hours for grades 4 and 5. The average hours 
of instruction also varied from pupil to pupil. Among elementary pupils the 
average weekly instructional time ranged from 3.0 to 3.1 hours. 

The average daily membership in the MIC-CAI program was 483.4 pupils. The 
average days of enrollment per pupil was 107.9 days, and the average attendant 
per pupil was 81.6 days. The average number of pupils served during the schr-M 
year per teacher by the 22 half-time MIC-CAI teachers was 3i.7 f although the 
average number of pupils enrolled per teacher on any given day was 22.0 (average 
daily membership divided by 22 teachers). The attendance criterion was met by 
601 pupils, or 86. 2Z of all program enrollees. Within grade levels the 
percentages of pupils served who met the attendance criterion ranged from 84.0% 
in grade 5 to 87.9% in grade 3. Data pertaining to enrollment and attendance are 
presented in Table 3. 

Pupil census information also Included the teacher's judgment of individual 
pupil progress as mu ch, some » little , or no progress. Of the 697 pupils served 
in the program 136 ( 19.52) were perceived by their program teachers as making 
much progress, 370 (53.1%) as making some progress, 169 (24.2%) as making little 
progress, and 22 (3.2%) as making no progress. 

The evaluation samples were limited to those pupils who were 
English-speaking, had both the pretest and posttest administrations of the 
appropriate standardized achievement tests, and met the attendance criterion. To 
meet the attendance criterion, pupils must have been enrolled at least 30 days 
and attended the program at least 80% of their instructional period. Of the 697 
pupils served, 1 (0.1%) was non-English speaking and therefore was excluded from 
the evaluation sample. Of the remaining 696 pupils, an additional 95 pupils were 
excluded due to nonattainment of the attendance criterion. Of the remaining 601 
pupils, 79 lacked either a pretest or posttest in Total Mathematics, leaving an 
evaluation sample of 522 pupils for that particular test, and 84 lacked either a 
pretest or posttest in Mathematics Concepts and Applications, leaving an 
evaluation sample of 517 pupils for that particular test. 

Standardized Achievement Test Information . Pretest^Posttest change score 
data for the MIOCAI program are summarized in Tables 4-7. The norma- curve 
equivalent (NCE), a standard score with a mean of 50 and a standard deviation of 
about 21 , is used in Tables 4-7 because it provides the truest indication of 
pupil growth in achievement. The NCE is an equal unit of measurement, aeaning 
that pretest and posttest change scores can be computed and averaged. It should 
be noted that NCEs, like percentile ranks, compare the pupils* performance in 
relation to the general population. No change In NCE score from pretest to 
posttest does not denote a lack of absolute progress; on the contrary, it means 
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TtbXe 3 

Number of Pupils Served; Averages for Days of Enrollment, 
Days of Attendance, Dally Membership, an<J Hours of Instru:tion Per Meek; 
and Pupils Meeting Attendance Criterion for MIC-CAI Program 

Reported by Grade Level 
1989-90 



Average Fupi I s Mee t i ng 

fupils Days of Days of Daily Hours of Instruction Attendance 

Grade Served Girls Boys Enrollment 3 Attendance** Membership per Pupil per Week Criteria 0 



3 


174 


99 


75 


108.0 


81. 4 


121.9 


3.0 


153 


4 


285 


145 


140 


109.3 


82.5 


198.1 


3. 1 


248 


5 


238 


131 


107 


106.2 


80.6 


163.3 


3. 1 


200 



Total 6W 375 322 107,9 81.6 483,4 3. 1 601 



^Days of errM^Bient were counted from the day after the chapter test was given to qualify the pupil 
through the diy w f trw chanter test indicating the pupil no longer needed treatment. Some MIC-CAI pupils 
may have had more than one enrollment period. 

b Pupil s normally received instruction an average of 3 class periods in a f t ve-school-day cycle at the 
elementary level. 

c Pupils must have been enrolled at least 30 days and must have attended the program at least 80% of their 
instructional days. 
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that over the school year the pupil has progressed at the expected rate of growth 
and has maintained the same relative position in terms of the general population. 
Even a small gain in NCEs indicates an advancement from .he pupils* oxiginal 
position relative to the general population. For readers interested in 
percentile statistics see Tables B-l and B-2 in Appendix B, pages 53 and 54. 

Table 4 contains a summary of pretest, posttest and change scores for Total 
Mathematics for the 522 MIC-CAI pupils in grades 3-5. The data in Table 4 show 
the total average growth in Total Mathematics skills for all pupils was greater 
than expected. Uhile the expected NCE change for the normal school population is 
zero NCE points during the course of a school year, the total average change f .z r 
MIC-CAI pupils was 10.5 MCE points. The greatest average gain in NCE points was 
achieved at grade 3 with 17.2 NCE points, while grade •* showed the smallest gain 
of 7.7 NCE points. Grade 5 showed a gain of 8.4 NCE points. All ttuee grade 
levels exceeded the 3.0 NCE criterion specified in the desired outcomes. The 
average NCE score on the posttest was 39.7, whereas a score of 50.0 would be at 
grade level. 

Table 5 contains data related to the changes in NCE scores for Total 
Mathematics for the three ranges: (a) no improvement in NCE bcores (0.0 or 
less), (b) ?ome improvement l& NCE scores (0.1 to 2.9), and (c) substantial 
improvement in NCE scores (3.0 or more). The data indicate that 399 pupils 
(76.4%) made gains in NCE scores. This means that 76.4% of the pupils in the 
evaluation sample progressed at a rate that was greater than expected for them. 
More specifically, 369 pupils (70.7%) made substantial improvement; 28 pupils 
(5.72) made some improvement; and 123 pupils (23.6%) made no improvement, as 
evidenced by a gain of 0.0 or a decline in NCE scores* 

Table 6 contains a summary of pretest, posttest and change scores for 
Mathematics Concepts and Applications for the 517 MIC-CAI pupils in grades 3-5. 
The data in Table 6 show the total average growth in Mathematics Concepts and 
Applications skills for all pupils was grater than expected. While the expected 
NCE change for the normal school population is zero NCE points during the course 
of a school year, the total average change for MIC-CAI pupils was 5.7 NCE 
points. The greatest average gain in NCE points was achieved at grade 3 with 
14.3 NCE points, while grade 5 showed the smallest gain of 1.3 NCE points. Grade 
4 showed a gain of 3.3 NCE points. Two of three grade levels exceeded the T.O 
NCE criterion specified in the desired outcomes. The average NCE score on the 
posttest was 38.3, whereas a score of 50.0 would be at grade level. 

Table 7 contains data related to the changes in NCE scores for Mathematics 
Concepts and Applications for the three ranges: (a) no improvement in NCE scores 
(0.0 or less), (b) some improvement in NCE scores (0.1 to 2.9), and (c) 
substantial improvement in NCE scores (3.0 or more). The data indicate that 335 
pupils (64.8%) made gains in NCE scores. This means that 64.8% of the pupils in 
the evaluation sample progressed at a rate that was greater than expected cor 
them. More specifically, 307 pupils (59.4%) made substantial improvement; 28 
pupils (5.4%) made some improvement; and 182 pupils (35.2%) made no improvement, 
as evidenced by a gain of 0.0 or a decline in NCE scores. 
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Table 4 



Minimum, Maximum, Average, and Standard Deviation of the Pretest and 
Posttest Normal Curve Equivalents (NCE) for MIC-CAI Program 
in Total Mathematics Reported by Grade Level 

1989-90 



Pretest 



Posttest 



Grade 


Number 
of Pupils 


Min. 


Max. 


Average 
NCE 


Standard 
Deviation 


Nin. 


Max. 


Average 
NCE 


Standard 
Deviation 


NCE 
Change 


3 


140 


1.0 


67.0 


27.0 


14.4 


1.0 


88.0 


44.2 


16.8 


17.2 


4 


220 


1.0 


73.0 


28.6 


10.7 


1.0 


82.0 


36. 2 


13.3 


7. 7 


5 


162 


1.0 


58.0 


32.2 


9.2 


6.0 


82.0 


40.6 


13.4 


8.4 


Total 


522 






29.3 


11.6 






39.7 


14.7 


10.5 



.... • • i (> rtrnrtM t r»on 
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Table 5 



Number and Percent of Pupils in Change Categories for 
NCE Scores for MIC-CAI Program in Total Mathematics 
Reported by Grade Level 
1989-90 



Change Categories for NCE Scores 

No Improvement Some Improvement Substantial Improvement Total Pupils 
(0.0 or leas) (0.1 to 2.9) (3.0 or more) in Sample 



(3.0 or more) 



Grade 3 

Number of Pupils 
Z of Pupils 



20 

14. n 



4 

2.9% 



116 
82. 92 



140 
26.82 



Grade 4 

Number of Pupils 
Z of Pupils 



63 

28. 62 



u 

7.72 



140 
63.62 



220 
42.12 



Grade 5 

Number of Pupils 
2 of Pupils 



40 

24.72 



9 

5.62 



113 
69.82 



162 
31.02 



Total Group 

Number of Pupils 
Z of Pupils 



123 
23.62 



30 
5.72 



369 
70.72 



522 

100.02 
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Table 6 

Minimum, Maximum, Average, and Standard Deviation of the Pretest and 
Posttust Normal Curve Equivalents (NCE) for MIC-CAl Program in 
Mathematics Concepts and Applications Reported by Grade Level 

1989-90 



Pretest Posttest Average 

Number Average Standard Average Standard NCE 

Grade of Pupils Mln. Max. NCE Deviation Min. Max. NCE Deviation Change 

3 139 1.0 64.0 27.2 13.4 l.Q 88.0 41.5 13.8 14.3 

4 220 1.0 76.0 33.7 10.9 2.0 77.0 37.0 13.2 3.3 

5 158 1.0 72.0 36.1 11.0 7.0 76.0 37.4 12.9 1.3 



Total 517 32./ 12.1 38.3 13.4 5.7 



Table 7 



Number and Percent of Pupils in Change Categories for 
NCE Scores for MIC-CAI Program in Mathematics Concepts and Applications 

Reported by Grade Level 
1989-90 



i Change Categories for NCE Scores 

No Improvement Some Improvement Substantial loproveoent Total Pupil 
(0.0 or less) (0.1 to 2.9) (3.0 or more) In Sample 



Grade 3 

Number of Pupils 
% of Pupils 



21 

15. IX 



4 

2.9% 



114 
82.02 



139 
26.9% 



Grade 4 

Number of Pupils 
% of Pupils 



85 

38.6% 



14 

6.4% 



121 
55.0% 



220 
42.6% 



Crade 5 

Number of Pupils 
% of Pupils 



76 

48.1% 



10 

6.3% 



72 

45.6% 



158 
30.6% 



Total Group „ , , l7 

Number of Pupils 182 28 307 517 

% of Pupils 35.2% 5.4% 59.44 100.0% 
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Potential Retalnee Information * Program teachers collected Information from 
pupils' regular classroom teachers about possible retention by December l t 1989. 
Using a locally developed Instrument, the Potential Retalnee Record Sheet, 
program pupils who were enrolled at least 30 days and who attended the program at 
least 30* of their instructional oeriod were identified by their teachers as 
being in danger of being retained early in the school vear. These 'fata were then 
compared with actual student records at the end of the school year. The data for 
the MlC^CAl program are summarized in Table 3. The data summarized In Table $ 
indicate that teachers identified 82 (14.6%) of the 560 program pupils as being 
potential retalnees early in the school year* However, of the 32 students so 
identified, only 13 (15. 9%) actually were retained in grade. In other words, 69 
(84.12) of the 32 pupils Identified were not retained in grade, far exceeding the 
criterion of 35% specified in the desired outcomes. 

Table S 

dumber of Potential and Actual Pupil detainees in the MIOCAI Program 

Total Number dumber of Pupils Identified Number of Pupils 

of Pupils as Potential detainees Actually Retained 

560 82 13 



Parent Involvement Information . The Parent Involvement Form provided 
information from teachers at the end of each month (September 1989 throngh June 
1990) concerning program activities involving parents who had children in the 
program. These data are presented by month in Table 9. Because teachers served 
pupils in both the MIC-CAI and the CLEAR-CAI programs, parent involvement data 
had to be prorated between the two programs. The data were prorated based on the 
number of full-time equivalent (FTE) teachers in each program. This accounts for 
the statistical oddity of the fractional parents encountered in Table 9. The 
months showing the most and least parent involvement were October, with a total 
of 2S9 # 9 contacts in 165.4 parent hours, and June, with a total of 41.3 contacts 
in 35.6 parent hours. 

Individual parent conferences accounted for more parent contacts (722.9) than 
any other activity. Yearly totals for the other activities were: sroup meetings 
with parents, 336.7 contacts In 432.4 parent hours; parent classroom visits or 
field trips, 155*2 contacts in 91.1 parent hours; planning, operation, and/or 
evaluation, 68.3 contacts in 56.4 parent hours; and visits by the teacher to 
parents - * homes, 28.3 contacts in 24.7 parent hours. The yearly totals for all 
five types of parent activity were 1311.4 parent contacts in 881.0 parent hours. 
Because a parent could have Involvement in more than one contact, a yearly 
undupllcated count was also obtained from program teachers in June. This count 
Indicated a total of 435 different parents of program pupils had one or more 
contacts with the program during the school year* . 

Inservlce "valuation Information . The General Inservlce Evaluation Form was 
completed by the MIC-CAI teachers for the four Inservlce meetings which occurred 
from September 1989 through November 1989. The number of inservlce meetings was 
greater than the minimum of two meetings that was specified in the program 
guidelines. Participants were asked after each session to rate four statements 



ERLC 



BVALSRVCS /P5 1 4 /RPTFMIC90 2 2 



Table 9 



Number of Parents Involved and Total Parent Hours 
for MIC-CAl Programs Reported by Month 
1989-90 



u Totals 
Mouths 



Program Activities 



s^r. — Sci: — — 6^ izr. far. 5^ sff- J — t £ 



1. Parents Involved In the 
planning, operation and/ 
or evaluation of your 
unit 

Number of Parents 
Total Parent Hours 

2. Group meetings for 
parents 

Number of Parents 
Total Parent Hours 

3. Individual parent 
conferences 

Number of Parents 
Total Parent Hours 

4. Parental classroom 
visits or field trips 

Number of Parents 
Total Parent Hours 

5. Visits by teacher 
to parents* homes 

Number of Parents 
Total Parent Hours 



Total Parent Contacts 
23 Total Parent Hours 

9 



16.5 
12.6 



79.8 
97.2 



79.0 
19.1 



9.4 
3.3 



1.6 
2.0 



186.2 
134.2 



15.3 
17.9 



86.4 
3 



91 



141.4 
36.7 



44.0 
17.1 



2.8 
2.4 



289.9 
165.4 



6.3 
6.9 



13.0 
7.5 



151.6 
80.9 



10.6 
7.3 



0.8 
0.8 



182.3 
103.4 



10.6 
3.5 



14.1 

22.8 



27.9 
12.0 



9.8 
6.5 



0.8 
1.4 



63.3 
46.2 



3.1 

2.4 



12.2 
14.7 



47.9 
18.1 



12.6 

7.7 



3.1 
4.1 



79.0 
47.0 



3.5 
3.1 



50.7 
88.6 



101.3 
44.2 



18.5 
9.4 



5.9 
2.9 



181 .9 
148.2 



3.5 
1.8 



43.6 
45.6 



76.6 
25«7 



18.1 
13.6 



4.7 
4.3 



146.5 
91.0 



2.4 
2.0 



11.8 
15.7 



36.5 
17.5 



8.3 
5.1 



5.1 
3.7 



3.9 
2.9 



20.0 
40.6 



39.3 
13.9 



12.2 
7.2 



1 .6 
1 .4 



3.1 
3.3 



5.1 
8.4 



19.3 
8.3 



1 1.8 
13.9 



2.0 
1 .7 



64.0 
44.0 



77.0 
66.0 



41.3 
35.6 



68.3 
56.4 



336.7 
432.4 



722.9 
276.4 



155.2 
91.1 



28.3 
24.7 



1311.4 
881.0 



ER? 0. »» were proved between the MOCH and C^Al T^T^ on program teach., I.ll-t.. ^-.valence (PTE). 
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about the Inservlce using x b -point scale which ranged from Strongly Agree (5) to 
Strongly Disagree (I). A copy of the General Inservlce Evaluation Form Is 
located on page 42 of Appendix A. 

Workshop participants generally gave the Chapter I Inservlce meetings high 
ratings. The average ratings for the four inservlce statements ranged from 4.6 
to 4.7 on the 5-polnt scale. Overall ratings by participants are summarized in 
Table 10. 

Open-ended questions on the General Inservlce Evaluation Form asked 
participants to comment about the most and least valuable parts of the meetings, 
and about additional information or topics they would like to have covereu in 
future meetings. Generally, participants mad* favorable comments on the 
inservlce topics, indicating that they enjoyed hands-on computer experience, 
sharing ideas with other program teachers, an^ teaming how to use various 
raanlpulatlves in Mathematics labs. These comments were summarized in the 
evaluation reports on Individual sessions that were submitted to the Department 
of Federal and State Programs and are available on request. 

Table 10 

Number Responding, Average Response, and Percent of Response 
For Reactions to Inservlce Statements for MIC-CAI Programs 

1989-90 



Percent 



Number Average SA A U D SD 

Statements Responding Response (5) (4) (3) (2) (I) 



1. I think this was 
a very worthwhile 

meeting. 91 4.7 74.7 23.1 2.2 0.0 0.0 

2. The Information 

»nted in this 
at. i.ng will assist 

me in my program. 91 4.7 72.5 26.4 LI 0.0 0.0 

3. There was time to ask 
questions pertaining 

to the presentation. 91 4.6 63.7 30.8 2.2 2.2 1.1 

4. Questions were 

answered adequately. 88 4.6 62.5 34.1 3.4 0.0 0.0 



Note. Ratings based on 5-polnt scale where SA-Stvongly Agree, A-Agree, 
U-Undecided, D-Dlsagree, and SD-Strongly Disagree. 

Computer Census Information . To supplement the data collection specified in 
the evaluation design, Information was obtained from all teachers in the MIC-CAI 
programs by means of a Computer Census Form (Chamberlain, 1990). This 
questionnaire was mailed In February and was completed by all MIC-CAI teachers by 
March 1990. Results of the Computer Census Form are presented In Table 11. 

er|c 25 
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Of the 22 elementary school labs* 19 had Apple microcomputers that were 
serviced by the Jostin Company. Jostin Company elementary labs were each 
-quipped with 6 Apple microcomputers, one of which was used for the teacher's 
tn~lab management system and for hands-on testing. Additional teaching machines 
were also used in th^se labs. 

One elementary school lab had the Sperry Network System and was serviced by 
Wasatch* This lab networked 4 Sperry microcomputers and I AT&T microcomputer as 
student stations, plus a 5th Sperry microcomputer which was limited to teacher 
use as a command module* 



Table 11 

Number of Labs* Average Pupil Time at the Computer 
and in the Program, and Percent Computer Time by Type 
of Lab for MIC-CAI Programs 
1989-90 



Type 
of Lab 



Number 
of Labs 



Average 



Minutes Per Week 
At Computer 



Minutes Per Week 
In Program 



Percent 
Computer 
Time 



Elementary 

Jostin (Apple) 19 

Wasatch (Sperry) I 

CCC Microhost 2 
Lab 



77.1 
180.0 
100.0 



182.4 
200.0 
200.0 



42.3 
90.0 
50.0 



Total 



22 



83.8 



184.8 



45.4 



Note. Adapted from Chamberlain, 1990. 



ERJC 



The remaining 2 elementary school labs (in one school) were serviced by the 
Computer Curriculum Corporation (CCC)r A central CCC microhost was hooked up to 
the individual microcomputers in the 2 labs. Each lab had a total of 8 
microcomputers for pupil use: 4 Apple and 4 Atari. In addition, each lab had a 
5th Atari which was used as a teacher management system. 

All of the elementary school labs that were used for MIC-CAI instruction were 
also used for CLEAR -CAI Instruction, however, several labs were used only for 
CLEAR-CAI Instruction. Some of the computer systems thai were in the elementary 
school CLEAR-CAI labs were not found in the labs used for both MIC-CAI and 
CLEAR~CAI pupils (Chamberlain, 1990). Specifically, the Integrated Language Arts 
(ILA) system, serviced by the Jostin Company; the Tandy TRS-80 color 
microcomputers, serviced by the B&B Company; and the Tandy 1000-SL microcomputers 
and Tandy 4000, serviced by Wasatch, were used for CLEAR-CAI but not MIC-CAI 
instruction. 
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Overall, KIC-CAI pupils received 45.4% of their instruction at the computer 
stations* It is notable , however , that the average percent of pupil computer 
time was considerably greater (90.0%) for the Sperry labs. Results from 
observations and interviews conducted In previous years ( Chamberlain , 1989) 
suggest that a variety of teacher-directed individual and group activities would 
account for the remaining program time* 



Process Evaluation Information . On-site visitations and teacher interviews 
were conducted by the program evaluator in March 1990 in 1 1 of 22 
tUC-Ele-aentary-CAl labs. The- instrument used, Evaluator' s Visitation Log, 
located on pages 44 to 51, in Appendix A, consisted of three parts: (1) a 
questionnaire consisting of 32 items grouped into 9 areas, with each item rated 
on a five-point scale, (2) a 16 item checklist of observed instructional 
activities, and (3) eight additional interview questions. For ease in 
interpretation, average ratings from the questionnaire were dichotomized as high 
(average ratings of 4.0 or higher) or in the mid-range or lower (average ratings 
of less than 4.0). 

The MIC-Elementary-CAI teachers gave the majority of rating scale items high 
ratings (average ratings of 4.0 or higher). In fact, only two of nine areas, 
Parent Involvement and Testing received consistently lower or aid-range ratings 
(average ratings of less than 4.0). Teacher ratings indicated that efforts to 
involve parents in school activities met with only moderate response (3.3), and 
that pupil behavior showed some improvement due to parent involvement (3.7). 
Also, teachers felt that the choice of achievement test was above average, some 
problems were encountered in administering the test, scheduling the test 
administration was difficult and the time required to administer the test was 
reasonable . 

The remaining seven areas received mostly higher rating". In the areas of 
Pupil Progress teachers were generally satisfied with overall pupil progress 
(3. J), and shared pupil progress with the classroom teacher (4.1). In the area 
of Coordination witJi Classroom Teacher, teachers indicated that classroom 
teachers were cooperative (4.4), and coordination with the classroom Leacher was 
effective (4.4). Joint planning with the classroom teacher was infrequent (2.3), 
however. The following areas received, consistently high teacher ratings: 
Selection Process (4.0 f ot all items), C <s Scheduling (4.3 to 4.5), Evaluation 
Feedback (4.3 to 4.5), and Materials Prov. .ad for Program (4.1 to 4.6). The area 
of Facilities received high ratings on all items (4.3 to 4.7), except 
Temperature /Ventilation, which received a slightly lower rating (3.8). 

In addition to the rating scale items, the process instrument addressed the 
variety of instructional activities that were usee* by MIC-Elementary-CAI 
teachers. The most frequently observed instructional activities observed were: 
Doing Computer Activities (81.&%) , Working on Drill and Practice (81.8%) , 
Reviewing and Strengthening Specific Skills (63.6%) and Working Problems at the 
Chalk Board (54.5%). 

Fi naily, teachers were asked several questions af ter the c lass room 
observations, most of which concerned various record-keeping procedures. Of 
note, however, were the three lr.ems which concerned coordination with the 
classroom teachers, contact with the home, and nonitorim pupil progress. In 
response to these questions, teachers indicated that informal contact was the 
primary method used for coordination with classroom teachers (90.9%); the 
Progress Reports (e.g. checklists, computer generated reports, etc.) were the 
primary method used to report to parents (90.9%); and the Computer Management 
System was the primary method of monitoring pupil progress (100.0%) • 
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Teachers also aad the opportunity zz comment on various facets of nhe 
program. Primary *reas of concern included not being able to administer the 
aistrictwide test in small jroup settings, ind difficulties In scheduling for 
some mpils due to other programs such *s PEAK. Teachers noted that they were 
\>ery pleased with the Instructional Management System, i computer program for 
organizing pupil data and producing reports on pupil progress. 

1IC Competency Basec Education Program (;iIC-C3E) 

Pupils were selected for the IlIC-CBE program on the basis of previous 
achievement test scores which indicated they were achieving at or below the 36th 
percentile in mathematics skills. Evaluation results are summarized as follows: 

Pupil Census Information * During the 1989-90 school year the ;iIC-CBE program 
served a total of 1,353 pupils in grades 3-8. Of the 1,353 pupils, 522 were in 
the elementary schools (grades 3-5), and 331 were in the middle schools (grades 
6-8). 

Overall, the average number of hours j£ instruction per pupil per week *ras 
1.7 hours. The average hours >f instruction varied by ^rade level and ranged 
from 1,4 hours for grades b-8, zo 2.2 hours for ^rade ^. The iverage hours 
Instruction also varied from pupil to pupil. Among elementary pupils the average 
weekly instructional time ranged from 2.1 co 2.* hours. 

The average daily membership in the ;IIC~CBE program was 520. 1 pupils. The 
average days of enrollment per pupil was 100.5 days, and the average attendance 
per pupil was 38.5 days. Thn average number of pupils served during the school 
year per teacher by the 22 MIC-CBE teachers was 61.5, although the average number 
of pupils enrolled per teacher on any ^iven d-*y was 23.6 (average daily 
membership divided by 22 teachers). The attendance criterion was met by 712 
pupils, or 52#6% of all program enroilees. Within grade levels the percentages 
of pupils served who met the attendance criterion ranged from 44.7% in gr^de 7 to 
67.7% in ^rade 8. Data pertaining to enrollment and attendance are presented in 
Table 12. 

Pupil census information also included the teacher's judgement of individual 
pupil progress as much, some , little , or n£ progress. 3f the 1353 pupils served 
in the program 358 (26.5£) were perceived by their program teachers as making 
much progress, 528 (39.0%) as making some progress, 36C (26.6%) as making little 
progress, and 107 (7.9%) as making no progress. 

The evaluation samples were limited to those pupils who were 
English-speaking, had both the pretest ind oosttest administrations of the 
appropriate standardized achievement tests, and met the attendance criterion. To 
meet the attendance criterion , pupils must have been enrolled at least 30 days 
and attended the program at least 80% of their instructional period. Of the 1353 
pupils served, 2 were non-English speaking and therefore were excluded from the 
evaluation sample. " c the remaining 1351 pupils, an additional 640 pupils were 
excluded due to nonattainment of the attendance criterion. Of the remaining 711 
pupils, 126 lacked either a pretest or posttest in Total Mathematics , leaving an 
evaluation sample of 585 pupils for that particular test, and 127 lacked either a 
pretest or posttest in Mathematics Concepts and Applications, leaving in 
evaluation sample of 584 pupils for that particular test. 

Standardized Achievement Test Information . Pretes t~Posttest change score 
data for the M1C-CBE program are summarised in Tables 13-16. As mentioned 
previously, the normal curve equivalent (NCE) is used in Tables 13-16 because it 
orovides tl*e truest indication of pupil growth in achievement* Again it should 

mo 
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Table 12 



Number of Pupils Served; Averages for Days of Enrollment > 
Days of Attendance, Daily Membership, and Hours of Instruction Per Week; 
and Pupils Meeting Enrollment and Attendance Criteria for MIC-CliE Program 

Reported by Grade Level 
1989-90 



Average t > ^ Pupils Meet in;; 

Pupils Days of Days of Daily Hours" of Instruction Enrollment and 

Grade Served Girls Boys Enrollment 3 Attendance^ Membership per Pupil per Week Attendance Criteria 0 



3 


149 


82 


67 


99.6 


52.9 


73.4 


2.1 


96 


4 


189 


97 


92 


99.0 


52.9 


94.1 


2.2 


12) 


5 




99 


85 


96.8 


49.2 


88.0 


2. 1 


109 


6 


462 


229 


233 


104.5 


31.3 


151.1 


1.4 


214 


7 


338 


163 


175 


98.5 


28.7 


103.7 


1.4 


151 


8 


3i 


18 


13 


99.5 


33.8 


9.8 


1.4 


21 



Total 1353 688 665 100.5 38.5 520. 1 1.7 712 



a Days of enrollment were counted from the day afttr the chapter test was given to qualify the pupil through the 
day of the chapter test indicating the pupil no longer needed tre.»ci:ent . Some MIOCBE pupils may have had more 
than one enrollment period. 

^Pupils normally received instruction an average of 3 class periods in a f i ve-school~day cycle at the elementary 
level while pupils in middle schools received instruction an average of 2 class periods in a f i ve~school~day cycle. 

c Pupils must have been enrolled at least 30 days and must have attended the program at least 80% of their 
instructional days. 
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Table 13 



Minimum, Maximum, Average, and Standard Deviation of the Pretest and 
Posttest Normal Curve Equivalents (NCE) for HIC-CBE Program in Total Mathematics 

Reported by Grade Level 
1989-90 



Pretest Posttest Average 

Number Average Standard Average Standard NCE 

Grade ot Pupils Min. Max. NCE Deviation Min. Max. NCE Deviation Change 

3 8i 1.0 59.0 27.9 14.1 7.0 80.0 48.1 13.9 20.3 

4 Kit i.O 59.0 28.3 11.8 6.0 7o.O 39.0 11.8 10,6 

5 85 6.0 69.0 34.4 9.9 1.0 79.0 42.7 16.9 8.3 

6 170 i.O 65.0 31.0 9.7 1.0 73.0 39.5 15.0 8.5 

7 130 i.O 47.0 28.9 8.2 1.0 92.0 40.6 13.0 11.7 

8 18 27.0 39.0 33. J 4.1 31.0 45.0 37.2 4.0 3.9 



Total 585 30.2 10.6 41.3 14.2 11.0 



Table 14 

Number and Percent of Pupils In Change Categories for 
NCE Scores for MIC-CBE Program in Total Mathematics 
Reported by Grade Level 
1989-90 



Change Categories for NCE Scores 



No Improvement Some Improvement Substantial Improvement Total Pupils 
(0.0 or less) (0.1 to 2.9) (3.0 or more) In Sample 



Crade 3 

Number of Pupils 
% of Pupils 



7 

8. 6% 



.7% 



71 

87.7% 



81 

13.8% 



Grade 4 

Number of Pupils 
% of Pupils 



16 

15.8% 



5 

5.0% 



80 

79.2% 



101 
17.3% 



Grade 5 

Number of Pupils 
X of Pupils 



23 

25.9% 



3 

3.5% 



60 

70.6% 



85 

14.5% 



Grade 6 

Number of Pupils 
% of Pupils 



51 

30.0% 



10 

5.9% 



109 
64.1% 



170 
29.1% 



Grade 7 

Number of Pupils 
X of Pupils 



28 

21.5% 



4 

3.1% 



98 

75.4% 



130 
22.2% 



Grade 8 

Number of Pupils 
% of Pupils 



3 

16.7% 



5 

27.8% 



10 

55.6% 



18 
3.1% 



Total Group 

Number of Pupils 

Z of Pupils 



127 
21.7% 



30 
5.1% 



428 
73.2% 



585 

100.0% 



I 



Table J 5 

Minimum* Maxfmuro, Average, and Standard Deviation of the Pretest and 
Posttest Normal Curve Equivalents (NCE) for MIC-CBE Program 
in Mathematics Concepts and Applications 
Reported by Grade Level 
1989-90 











Pretest 








Posttest 




Average 


Grade 


Number 
of Pupils 


Mln. 


Max. 


Average 

NCE 


Standard 
Deviation 


Mln. 


Max. 


Average 
NCE 


Standard 
Deviation 


NCE 

Change 


3 


82 


1.0 


99.0 


2 f /.8 


13.8 


1.0 


81.0 


46.0 


13.9 


16.2 


4 


103 


1.0 


60.0 


33.7 


11.5 


2.0 


77.0 


38.1 


11.9 


4.4 


5 


81 


21.0 


72.0 


39.0 


7.9 


7.0 


80.0 


39.9 


15.8 


0.9 


6 


170 


7.0 


66.0 


31.6 


11. 0 


3.0 


68.0 


36.6 


13.2 


5.0 


7 


130 


1.0 


54.0 


29.2 


9.4 


1.0 


90.0 


41.5 


14.1 


12.2 


8 


18 


20.0 


45.0 


32.0 


7.0 


21.0 


50.0 


34.4 


7.3 


2.4 


Total 


584 






32.2 


11. 1 






39.7 


13.9 


7.4 



34 



35 



9 
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Table 16 

Number and Percent of Pupils in Change Categories for 
NCE Scores for MIC-CBE Program in Mathematics Concepts and Applications 

Reported by Grade Level 
1989-90 



Grade 3 

Number of Pupils 
% of Pupils 



Change Categories for NCE Scores 



No Improvement Some Improvement Substantial Improvement 
(0.0 or less) (0.1 to 2.9) (3.0 or more) 



7 

8.5% 



3 

3.7% 



72 

87.8% 



Total Pupils 
In Sample 



82 

14.0% 



Grade 4 

Number of Pupils 
Z of Pupils 



35 

34.0% 



10 

9.7% 



58 

56.3% 



103 
17.6% 



Grade 5 

Number of Pupils 
% of Pupils 



35 

43.2% 



6 

7.4% 



40 

49.4% 



81 

13.9% 



Grade 6 

Number of Pupils 
% of Pupils 



66 

38.8% 



9 

5.3% 



95 

55.9% 



170 
29.1% 



Grade 7 

Number of Pupils 
% of Pupils 



27 

20.8% 



5 

3.8% 



98 

75.4% 



130 
22.3% 



Grade 8 

Number of Pupils 
% of Pupils 



8 

44.4% 



2 

11.1% 



8 

44.4% 



18 

3.1% 



Total Group 

Number of Pupils 
X of Pupils 



178 
30.5% 



35 
6.0% 



371 
63.5% 



584 

100.0% 



ERJC 
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be noted that NCEs Hke percentile ranks* compare the pupils' performance In 
relation to the general population. No change in NCE score from pretest to 
posttest does not denote a lack of absolute progress; on the contrary* it means 
that over the school year the pupil has progressed at the expected rate of growth 
and has maintained the same relative position Ln terms of the general 
pooulation. Therefore even a small gain in NCEs indlc-.tes an advancement from 
the pupils' original position relative to the general population. For readers 
interested in percentile statistics, see Tables B-3 and B-4 in Appexdlx B, pages 
55 and 56. 

Table 13 contains a summary of pretest, posttest and change scores for Total 
Mathematics for the 585 MIC-CBE pupils in grades 3-8. The data In Table 13 show 
the total average growth in Total Mathematics skills for all pupils was greater 
than expected. While the expected NCE change for the normal school population Is 
zero NCE points during the course of a school year, the total average change for 
MIC-CBE pupils was ll.O NCE points. The greatest average gain in MCE points was 
achieved at grade 3 with 20.3 NCE points, while grade 8 showed the smallest gain 
of 3.9 NCE points. All grade levels exceeded the 3.0 NCE criterion specified in 
Che desired outcomes. The average NCE score on the posttest was 41.3 whereas a 
score of 50.0 would be at grade level. 

Table 14 contains data related to the changes in NCE scores for Total 
Mathematics for the three ranges: (a) no improvement in NCE scores (0.0 or 
less), (b) some improvement in NCE scores (0.1 to 2.9), and (c) substantial 
improvement in NCE scores (3.0 or more). The data indicate that 458 pupils 
(78. 3X) made gains in NCE scores. This means that 78.3% of the pupils in the 
evaluation sample progressed at a rate that was greater than expected for them. 
More specifically, 428 pupils (73. 2%) made substantial improvement; 30 pupils 
(5. IS) made some improvement; and 127 pupils (21. IX) made no improvement, as 
evidenced by a gain of 0.0 or a decline in NCE scores. 

Table 15 contains i summary of pretest, posttest and change scores for 
Mathematics Concepts and applications for the 584 MIC-CBE pupils in grades 3-8. 
The data in Table 15 show the total average growth In Mathematics Concepts and 
Applications skills for all pupils was greater than expected. While the expected 
MCE change for the normal school population is zero NCE points during the course 
of a school year, the total average change for MIC-CBE pupils was 7.4 NCE 
points. The greatest average gain in NCE points was achieved at grade 3 with 
16.2 NCE points, while grade 5 showed the smallest gain of 0.9 NCE points. This 
small gain at grade 5 was less than the 3.0 NCE criterion specified in the 
desired outcomes. Grade 8 also fell below the specified criterion with an NCE 
gain of only 2.4. The remaining grade levels exceeded the 3.0 NCE criterion 
specified in the desired outcomes. The average NCE score on the posttest was 
39.7 whereas a score of 50.0 would be at grade level- 

Table 16 contains data related to the changes in NCE scores for Mathematics 
Concepts and Applications for the three ranges: (a) no improvement in NCE scores 
(0.0 or less), (b) some improvement in NCE scores (0.1 to 2.9), and (c) 
substantial improvement in NCE scores (3.0 or more). The data indicate that 406 
pupils (69. 57.) made gains in NCE scores. This means that 69.5% of the pupils in 
the evaluation sample progressed at a rate that was greater than expected for 
them. More specifically, 371 pupils (63.5%) made substantial improvement; 35 
pupils (6.02) made some Improvement; and 178 pupils (30.5%) made no improvement, 
as evidenced by a gain of 0.0 or a decline in NCE scores. 

Potential Re tainee /Course Failure Information . Program teachers collected 
information from pupils' regular classroom or subject area teachers about 
possible retention/course failure by December I, 1989. Using locally developed 
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Instruments, the Potential Retainee Record Sheet at the elementary level and the 
Potential Course Failure Record Sheet at the middle level, prograo pupils who 
were enrolled at least 30 days and who attended the program at least 30% of their 
Instructional period were Identified by their teachers as being In danger of 
being retained or failed early in the school year* These data were Chen compared 
with actual student records at the end of the school year* 

The results for Che MIC-CBE program are summarised tn Table 17. The data 
summarized in Table 17 indicate that of the 638 program pupils, teachers 
identified a total of 139, or 29. 62, as being potential retainees or course 
failures early in the school year. Of the 139 pupils so identified, 139 (73.52) 
were at the middle school level. The number of pupils actually retalned/f ailed 
was 59 (31.2%) of the 189 pupils identified as possible retainees/f allures. In 
other words, 130 (68.8%) of the 139 pupils identified were not retained/failed, 
far exceeding the criterion of 35% specified In the desired outcomes. 

1 1 should be noted that of the 59 actual retainees / course f ai lures , 50 
(84.7%) were at the middle school level. In other words, at the elementary 
level, 9 (18.0%) of 50 pupils identified as potential retainees actually were 
retained. At the middle school level, 50 (36.0%) of 139 pupils identified as 
potential course failures actually failed their mathematics course. 



Table 17 

Number of Potential and Actual Pupil Retalnees/Course Failures 
by fJrade-Level tn the MIOCBE Program 



Grade Total Number Number of Pupils Identified Number of Pupils 

Level of Pupils as Potential Retainees Actually Retained 

Elementary 294 50 9 
Middle 344 139 50 
Total 638 18? 59 



Parent Involvement Information . The Parent Involvement Form provided 
information from teachers at the end of each month (September 1989 through June 
1990) concerning program activities involving parents who l.ad children in the 
program. Results are presented by month in Table 18. The months showing the 
most and least parent involvement were October, with a total of 382.0 contacts in 
285.5 parent hours, and June, with a total of 42.0 contacts in 64.0 parent hours* 
Individual parent conferences accounted for more parent contacts (1066.0) than 
any other activity. Yearly totals for the other activities were: group meetings 
with parents, 303.0 contacts in 323.0 parent hours; parent classroom visits or 
field trips, 189.0 contacts in 141 .5 parent hours; planning, operation, and/or 
evaluation, 86.0 contacts in 59*0 parent hours; and visits by the teacher to 
parents' homes, 7 # 0 contacts in 5.0 parent hours. The yearly totals for all five 
types of parent activity were 1651.0 parent contacts in 940.5 parent hours. 
Because a parent could have involvement in more than one contact, a yearly 
unduplicated count was also obtained from program teachers in June. This count 
indicated a total of 739 different parents of program pupils had one or more 
contacts with the program during the school year. 
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Table 18 



Number of Parents Involved and Total Parent Hours 
tor MIC-CBE Program Reported by Month 
1989-90 



Months Totals 





Program Activities 


Sepf • 


Oct* 


Nov. 


Dec* 


Jan. 


Feb. 


Mar. 


4pr. 


May 


T 

June 


for 

Year 


• 

I • 


Parents involved In the 


























planning, operation and/ 


























or evaluation of your 


























unit 


























Number of Parents 


4.0 


18.0 


U.O 


16.0 


5.0 


8.0 


6.0 


4.0 


9.0 


5.0 


86.0 




Total Parent Hours 


7.G 


12.5 


6.5 


4.5 


4.5 


5.0 


6.0 


3.5 


5.5 


4.0 


59.0 


2. 


Group meetings for 


























parents 


























Number of Parents 


18.0 


142.0 


23.0 


22.0 


11.0 


13.0 


64.0 


0.0 


9.0 


1.0 


303.0 




Total Parent Hours 


27.0 


169.0 


9.0 


7.0 


14.0 




74.0 


0.0 


5.5 


• A 

t .0 


■I'll A 


J* 


Individual parent 


























conferences 


























Number or Parents 


/.a a 




1 /9.0 


76.0 


AA A 

90.0 


2*1 .0 


124.0 


78.0 


69. U 




lubo.U 




Total Parent Hours 


16.0 


75.0 


70.5 


26.0 


33.0 


88.0 


45.5 


25.0 


25.0 


8.0 


412.0 


4. 


Parental classroom 


























visits or field trips 


























Number of Parents 


11. 0 


83.0 


9.0 


11. 0 


11. 0 


27.0 


8.0 


4.0 


13.0 


12.0 


189.0 




Total Parent Hours 


5.0 


29.0 


4.5 


15.0 


6.5 


9.0 


4.0 


3.5 


14.0 


51.0 


141.5 




Visits by teacher 


























to parents' home9 


























Number of Parents 


1.0 


0.0 


0.0 


1.0 


1.0 


2.0 


1.0 


1.0 


0.0 


0.0 


7.0 




Total Parent Hours 


0.5 


0.0 


0.0 


1.5 


1.0 


1.0 


0.5 


0.5 


0.0 


0.0 


5.0 




Total Parent Contacts 
Total Parent Hours 


82.0 
55.5 


382.0 
285.5 


222.0 
90.5 


126.0 
54.0 


118.0 
59.0 


291 .0 
119.5 


201.0 
130.0 


87.0 
32.5 


100.0 

50.0 


42.0 
64.0 


1651.0 

940. 5* 
0 
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tnservlce Evaluation Information . The General Inservtce Evaluation Form, 
Located on page 42 of Appendix A, was completed by MIC-CBE teachers for the five 
tnservlce meetings which occurred from Aigust 1989 through Hay 1990. The number 
of Inservtce meetings was greater than the minimum of two meetings during the 
school year that was specified In the program guidelines. All five of the 
meetings were attended by both elementary and middle school MIC-CBE teachers (see 
Table 2, p. 6). Participants were asked after each session to rate four 
statements about Che tnservlce using a 5-polnt scale which ranged from Strongly 
Agree (5) to Strongly Disagree (1). 

Workshop participants generally gave the Chapter I Inservtce meetings high 
ratings. The average ratings for the four tnservlce statements ranged from 4.6 
to 4.8 on the 5-point scale. Overall ratings by participants are summarised tn 
Table 19. 



Table 19 

Number Responding, Average Response, and Percent of Response 
For Reactions to tnservlce Statements for MIC-CBE Program 

1989-90 



Statement 



Number 
Responding 



Average 
Response 



SA 

(3) 



Percent 



A 

(4> 



U 

(3) 



D 

(2) 



SO 
(D 



I. I think this was 
a very worthwhile 
meeting. 



83 



4.8 



85.5 12.1 2.4 0.0 0.0 



The information 
presented In this 
meeting will assist 
me in my program. 



83 



4.8 



83.1 



15.7 i.2 0.0 0.0 



3. There was time to ask 
questions pertaining 
to the presentation. 



80 



4.7 



78.8 



12.5 5.0 3.7 0.0 



4. Questions were 

answered adequately. 



82 



4.6 



70.7 19.5 4.9 4.9 0.0 



Note . Ratings, based on 5-polnt scale where SA-Strongly Agree, 
U-Undecided, D-Dtsagree, and SD«Strongly Disagree. 



A«Agree , 



Open-ended questions on the General Inservtce Evaluation Form asked 
participants to comment t>bout the most and least valuable parts of the meetings, 
and about additional Information or topics they would like to have covered in 
future meetings. Specific comments were summarized tn the evaluation reports on 
tnservlce meetings that were forwarded to the Department of Federal and State 
Programs and are available on request. Many teachers commented favorably on the 
use of the Computer Management System In streamlining their record keeping 
duties, and they desired more tnservlce meetings on the same subject. 
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Pr ocess Evaluation Information . On-site visitations and teacher interviews 
were conducted by the program evaloator in March 1990 In eight of 10 
MIC-Elementary-CBE labs and all 12 MtO-Mlddle-CBE labs. The instrument used, 
5 valuator's Visitation Log, consisted of three parts* (O a questionnaire 
consisting of 32 items grouped into 9 areas, with each item rated on a flve-poUt 
scale, (2) a 16 item checklist of observed Instructional activities, and (3) 
eight* additional interview questions. For eoae in interpretation, average 
ratings from the questionnaire were dlchotoniz'-d as high (average ratings of 4.0 
or higher) or In the mid-range or lower (average ratings of less than 4.0). 

The MIC-CBE teachers gave the majority of rating scale Items high ratings 
(average ratings of 4.0 or higher), although many items received mid-range 
ratings (average ratings of 3.0 to 3.9). One area that received consistently 
lower ratings was Parent Involvement. Teacher ratings Indicated that efforts to 
Involve parents In school activities met with little success at either the 
elementary (2.8) r the middle school level (2.0). Teachers Indicated that papll 
behavior showed some Improvement due to parent Involvement at both levels (2.9 to 
1.0), and progress reports to parents were infrequent (2.4 to 2.5). 

The remaining eight areas received mostly higher tatlngs. In the area of 
Pupil Progress teachers were generally satisfied with overall pupil progress, 
with the elementary teachers (4.1) a little more satisfied than middle school 
teachers (3.6). Pupil Progress was shared with the classroom teacher (4.3 to 
4.6). In the area of Coordination with Classroom Teacher, teachers indicated 
that classroom teachers were cooperative (4.5 to 4.8), and coordination with the 
classroom teacher was effective. (4.4). Joint planning with the classroom teacher 
was not ftequent (3.1 to 3.3), however. In the area of Selection Process, 
teachers assigned slightly lower ratings to the test choiee (3.5 to 3.9) and 
problems with test (3.6 to 3.9) items, than to the items on procedures (4.3 to 
4.4) and time required (3.4 to 4.0). Similarly, in the area of Testing (CTBS), 
teachers assigned slightly lower ratings to the choice of test (3.7 to 3.8), 
problems with the test (3.7), and scheduling the test (3.8 to 3.9), than to 
testing procedures (4.1 to 4.3) and tlrse required (3.9 to 4.0). In the area of 
Evaluation Feedback the teachers indicated that the quantity of information was 
satisfactory (4.3) as well as useful (4.1 to 4.5) but gave slightly lover ratings 
to the timeliness of such Information (3.9). The area of Facilities varied in 
ratings for different Items. The highest rated Item in this area was lighting 
(4.3) while the lowest rated item was temperature /ventilation (3.1 to 3.4). 
Ratings on the Item on storage Indicated that elementary teachers (4,0) 
apparently had more storage area than middle school teachers (3.0). The two 
remaining areas, Class Scheduling (4.3 to 4.9) and Materials Provided for Program 
(4.3 to 4.4) were consistently rated high by all program teachers, elementary and 
middle. 

In addition to rating scale items, the process Instrument addressed :he 
variety of Instructional activities that were used by MIC-CBE teachers. The most 
frequently observed Instructional activity In elementary classrooms was Ooing 
Computer Activities (100.0%), while in middle school classrooms Reviewing and 
Strengthening Specific Skills (75. OS) was the most frequently observed 
Instructional activity. 

Finally, teachers were asked several questions after the classroom 

observations, uost of which concerned various record-keeping procedures. Of 

note, however, were the t ea items which concerned coordination with the 

classroom teachers, contact th the home, and monitoring pupil progress. In 

response to these questions, teachers indicated that informal contact was the 

primary method used for coordination with classroom teachers (100. 0%); tut* 

Progress Reports (e.g. checklists, computer generated reports, etc.) were the 
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primary methods used to report to parents (75*02) by middle school teachers, 
while ?areat Conferences were the primary means used by elementary teachers 
(75.01); and the Computer Management System was the primary method »f monitoring 
pupil progress (100.0%). 

Teachers also had :he opportunity to comment on various facets of the 
program. Primary areas of concern included difficulties in setting parents to 
risit schools and a general lack of space In some program labs. Teachers noted 
that they were generally satisfied with pupil progress and that pupils had an 
improved attitude about math labs. 

Summary 



The Mathematics Improvement Component (MIC) provided supplementary 
instruction to selected elementary and middle school pupils who were low 
achievers in mathematics. The purpose of MIC was to improve mathematics skills 
and levels of achievement. Three programs comprised MIC: the Elementary 
Computer Assisted Instruction (EleorCAI) Program* the Elementary Competency Based 
Education (Slem-CBE) Program, and the Middle School Competency Based Education 
(Middie-CBE) Program. U the elementary level, pupils were served an average of 
chree times ,i week, while at the middle school level pupils were served .in 
average of two times a week. In all programs selected pupils were permitted to 
move in and out of the program as needed during the school year. 

Evaluation of the MIC programs included the collection of data in seven 
areas: (i) Pupil Census Information* (2) Standardized Achievement Test 
Information, (3) Potential Retainee Information, (4) Parent Involvement 
Information (5) Inservice Evaluation Information, (6) Computer Census Information 
(MIC-CAI only), and (7) Process Evaluation Information. These data were analyzed 
to obtain a broad measure of the programs'* success, and in particular to 
ascertain the degree to which the programs achieved the following three desired 
outcomes: 

Xt least 50% of the pupils who were enrolled at least 30 days and who 
attended the orogram at l->ast 30% of their instructional period will gain at 
least 3.0 normal curve equivalent (MCE) points for the instructional period 
in total mathematics* "aln will be measured by i nationally standardized 
achievement test of mathematics. 

\t least 50% of the pupils who were enrolled at least 30 days and who 
attended the orogram at least 30% of their instructional period will gain at 
least 3.0 normal curve equivalent (NCE) points for the instructional period 
in mathematical concepts and applications. Gain will be measured by a 
nationally standardized test. 

At least 35% of the pupils who were enrolled at least 30 days 3nd who 
attended the program at least 30% of their instructional period and who are 
identified by their classroom teacher on or before December i, 1989 as being 
in danger of being retained will not be retained (grades 3-5) or as being in 
danger of failing the course in which mathematics instruction occurs will not 
fail (grades 6-*). 

Elementary Computer Assisted Instruction Program (MIC-CAI) 

Pupil Census Form data indicated that a total of 697 pupils in grade 3-5 were 
served by the 22 half-time MIC-CAI teachers in 20 elementary schools. The 
average number of MIC-CAI pupils served during the school year per teacher was 
31.7. The average number of MIC-CAI pupils enrolled per teacher on any given day 
ERIC was 22 *°* T k* average amount of instruction per week was 3.1 hours. The average 
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hours o: instruction per week varied only slightly from grade level to grade 
level and ranged from 3*0 to 3.1 hours. 

The = valuation sample for Total Mathematics consisted of 522 pupils in grades 
3-5 who -ere English-speaking, met the attendance criterion, and took the pretest 
and posttest. Analyses of the CTSS Total Mathematics scores indicated an average 
change :i 10.5 NCE polr.ts. Results exceeded the evaluation criterion for 
mathematics growth of 3.0 NCE points specified In the first desired outcome. The 
criterion was - xceeded in each grade level, with grade 3 achieving a aaln of 17.2 
•JCEs. 

"or '.athematlcs Concepts and Applications the evaluation sample consisted of 
517 pupils in grades 3-5 who were English-speaking, net the attendance criterion, 
and took the pretest and posttest. \naiyses of the CTBS Mathematics Concepts and 
Applications scores indicated an average change of 5.7 NCE points. Results 
exceeded the evaluation criterion for mathematics growth of 3.0 'ICE points 
specified tn the second desired outcome. The criterion was exceeded In two of 
three grade levels, with grade 5 achieving ai NCE gain of only 1.3. 

Earl- in the school year, a locally developed instrument, the Potential 
Retainee Record Sheet, was used to identify program pupils in danger of being 
retained. Teachers identified 82 (14.6%) pupils of the 560 program pupils 
listed, $s being potential retalnees. At the end of the school year, records 
indicated that only 13 (15.9%) of the potential retalnees were actually 
retained. l\t other words, 69 of the 82 (84.1%) pupils Identified, were not 
retained tn grade, far exceeding the criterion of 35. OX specified tn the third 
desired outcome. 

Program teachers reported a total of 1311.4 contacts during the school year 
with 435 different parents of program pupils. The number of contacts and hours 
varied 27 month. Individual parent conferences accounted for more parent 
contacts than any other type of activity. 

Evaluation forms were completed for the three inservlce meetings. The 

meetings ^ere rated highly, with the average ratings ranging from 4.6 to 4.7 on a 

5-polnt scale, where (5) represented "Strongly Agree" and (1) represented 
"Strong!:' Disagree." 

A survey of program teachers indicated that most of the elementary CAI labs 
had Apole microcomputers serviced by the Jostln Company. The exceptions were 2 
labs that had Computer Curriculum Corporation computers and I lab that had the 
Sperry Network System that was serviced by W&satch. According to teacher 
reports, the overall average amount of time pupils worked at the computer 
stations was 45.41 of program Instructional time. 

During the month of March 1990, on-site visitations and teacher interviews 
were conducted in 11 of 22 MIC-CAI labs as part of a process evaluation. Program 
teachers were observed during a classroom session, and then interviewed about 
different aspects of the program. The program teachers, prior to the visit, also 
completed a 32 Item questionnaire covering nine areas deemed important to the 
program. Results of the evaluation indicated that program teachers thought 
Parent Involvement was the one area most tn need of improvement. Other areas, 
such is Class Scheduling and Materials Provided for Program received very 
positive ratings from teachers. In the classroom, the most frequently observed 
instructional activities were Doing Computer Activities and Working on Drill and 
Practice. The primary method of monitoring pupil progress was the Computer 
Management System employed by program teachers, and the Progress Report was the 
most frequently employed method of reporting to parents. 
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elementary and Middle School Competency Based Education Program (MIC-CBE) 

The MIC-CBE program was Implemented by 22 teachers serving a total of 23 
school, U at the elementary level and 12 at the middle school level. One 
teacher served half-time at two elementary schools. Pupil Census Form data 
Indicated that a total of 1353 pupils Ln gtades 3-8 were served in the MIC-CBE 
program. Of the 1353 pupils, 522 were In elementary schools and 831 were in 
middle schools. The average number of pupils served during the school year per 
teacher was 61.5. The average number of pupils enrolled per teacher on any given 
day was 23.6. The average amount of instruction per week was 1.7 hours. The 
average hours of Instruction per week varied by grade level and ranged from 1.4 
hours for grades 6-8, to 2.2 hours for grade A. 

The evaluation sample for Total Mathematics consisted of 585 pupils in grade9 
3-8 who were English-speaking, met the attendance criterion, and took the pretest 
and posttest. Analyses of the CTBS Total Mathematics scores indicated an average 
change of 1 1.0 MCE points. Results exceeded the evaluation criterion for 
mathematics growth of 3.0 NCE points specified in the first desired outcome. The 
criterion was exceeded in each grade level, with grade 3 achieving a gain of 20.3 
NCEs. The smallest gain was achieved at grade 8, with 3.9 NCEs. 

The Mathematics Concepts and Applications evaluation sample consisted of 584 
pupils in grades 3-8 who were English-speaking, met the attendance criterion, and 
took the pretest and posttest. Analyses of the OTBS Mathematics Concepts and 
Applications scores indicated an average change of 7.4 NCE points. Results 
exceeded the evaluation criterion for mathematics growth of 3.0 MCE points 
specified in the second desired outcome. The criterion was exceeded at all but 
two grade levels. The greatest gain was achieved at grade 3, with 16.2 NCEs. 
Grades 5 and 8 achieved only small gains of 0.9 NCEs and 2.4 NCEs respectively. 

Early in the school year, two locally developed instruments, the Potential 
Ret a I nee Record Sheet at the elementary level, and the Potential Course Failure 
Record Sheet at the middle level, were used to identify program pupils in danger 
of being retained/failed. Teachers identified 189 pupils or 29.6% of the 638 
program pupils listed, as being potential retainees /course failures. At the end 
of the school year, records indicated that 59 or 31. 21 of the potential retainees 
were actually retained. In other words, 130 of the 189 pupils identified, or 
t>8.8%, were not retained in grade or failed, far exceeding the criterion of 35.0% 
specified in the third desired outcome. 

Program teachers reported a total of 1651.0 contacts during the school year 
with 739 different parents of program pupils. The number of contacts and hours 
varied by month. Individual parent conferences accounted for more parent 
contacts than any other type of activity. 

Evaluation forms were completed for the three inservice meetings. The 

meetings were rated highly, with the average ratings ranging from 4.6 to 4.8 on a 

5-point scale, where (5) represented "Strongly Agree" and (1) represented 
"Strongly Disagree." 

During the month of March 1990, on-site visitations and teacher Interviews 
were conducted In eight of 10 MIC-Eleraentary-CBE labs and all 12 MIC-Mlddle-CBE 
labs as part of a process evaluation. The same Instrument and procedures were 
used as had been employed In the KIC-CAI labs. The results of the evaluation 
were also similar to those found ln the MIC-CAI program. Again program teachers 
clearly rated the area of Parent Involvement lower than all other areas. Other 
areas received generally favorable ratings. The most frequently observed 
instructional activities observed In the MIC-CBE classrooms were Doing Computer 
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Activities at the elementary level, and Reviewing and Strengthening Specific 
Skills and/or Concepts at the middle school level. tn all classrooms. Informal 
Contact was the piimary method of coordination with classroom or subject area 
teachers. The primary method used to report to parents was the Parent Conference 
at the elementary level, and Progress Reports at the middle school level. The 
primary method used to monitor pupil progress was the Computer Management System 
at both elementary and middle school levels. 



Recommendat ions 

Based on the 1989-90 evaluation results for both the MIC-CAI and the MIC-CBE 
programs, the following recommendations are in order: 

1. The standardized test scores indicated a slightly greater achievement 
gain at grades 3 and 4 for the MIC-CBE pupils. \t grade 5, the MIC-CAI 
pupils showed a slightly greater achievement gain than MIC-CBE pupils. 
However it is difficult to draw conclusions comparing the two programs' 
effectiveness without a controlled study which takes into account 
variations in program Implementation (e.g., the use of different types of 
instructional TJethods, computer equipment, the percent of pupil time 
using computers). Such an examination is recommended to determine the 
most effective methods of improving the skills and achievement levels of 
pupils who are low achievers in mathematics. 

2. Achievement test data indicate that program pupils are making gains in 
improving their skills in mathematics. It is recommended that 
Mathematics Improvement Programs, in some form, should be continued. 

3. Special efforts need to be made to improve the achievement levels of the 
program pupils who showed M no improvement" from pretest to posttest on 
the standardized achievement test. 

4. Program teachers should involve themselves as much as possible as 
proctors in the standardized achievement test administration. 

5. Program teachers should meet with classroom teachers on a regular basis 
for planning instructional strategy. 

6. The nature and amount of movement In and out of the program should be 
determined because it is a key aspect of the program. 

7. Methods for encouraging parent involvement should be actively sought and 
successful methods shared. 
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CHAPTER i EVALUATION 
PARENT INVOLVEMENT SURVEY 



mailing label 
goes here 



% iame 



School 



F>- the month of MAY 



DIRECTIONS: U Complete all Information according to the instructions, fold 

over so back is showing, staple f and place in school mail* 

2. Place a parent in only one activity for any one meeting. 

3. Total hours (Column B) equals the number of parents times the 
number of hours spent, e.g., a group meeting for 10 parents 
which lasts 3 hours would result in 10 parents (Column A) and 
30.0 hours (Column B), 15 parent conferences each for 30 minutes 
would result in 15 parents and 7.5 hours. Please round all 
figures in Column B to the nearest half hour. Enter half 
hours as .5, no fractions please. 

4« Item 6 - This is the number of different parents seen during the 
month. If you had 16 parent conferences but 10 conferences 
were with the same parent* the number is 7 parents - you saw 7 
parents but had 16 conferences. Do not count the same parent 
more than once for the month. 

(A) (B) 
Number of Total 
Parents Number of Hours 

I. Parents involved in the planning, operation* 

and/or evaluation of your unit * , , 



2. Group Meetings for Parents 

3. Individual Parent Conferences 
( include phone conferences) 

f 4. Parental Classroom Visits or Field Trips 

5. Visits by you to Parent Homes 



6. Number of different parents seen during the month 



PLEASE PUT IN SCHOOL MAIL NO LATER THAN FRIDAY » JUNE 1. 1990 
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'tailing Label Here 

CHAPTER i EVALUATION 

PARENT INVOLVEMENT SURVEY 



i i 



CHAPTER 1 ANNUAL PARENT COUNT 

Enter in the host to the left the number of different parents 
you had involved this school year. COUNT EACH PARENT ONLY 
ONCE FOR THE YEAR . If you have questions, please call Jane 
'.U 1 1 lams at 365-5167. 



COMPLETE THE REST OF THIS REPORT FOR JUNE ONLY 

DIRECTIONS: I. Complete all information according to the instructions, fold 

over so back Is showing, staple, and place in school mall. 

1. Place a parent in only one activity for any one meeting. 

3. Total hours (Column B) equals the number of parents times the 
number of hours s>v.it, e.g., a group meeting for 10 parents 
which lasts 3 houts would result In 10 parents (Column A) and 
30.0 hours (Column ft), 15 parent conferences each for 30 minutes 
would result In 15 parents and 7.5 hours. Please round all 
figures in Column B to the nearest half hour. Enter half 
hours as .5. no fractions pleaae. 

4. Item 6 - This is the number of different parents seen during the 
month. If you had 16 parent conferences but 10 conferences 
were with the same parent, the number is 7 parents - you saw 7 
parents but had 16 conferences. Do not count the same parent 
more than once for the month. 

(A) 0D 
Number of Total 
Parents Number of Hours 



Activities 

t. Parents Involved in the planning, operation, 
and/or evaluation of your unit 

Z. Group Meetings for Parents 

3. Individual Parent Conferences 
(Include phone conferences) 

4. Parental Classroom Visits or Field Trips 

5. Visits by you to Parent Homes 



6. Number of different parents seen during the month 



PLEASE PUT IN SCHOOL MAIL NO LATER THAN FRIDAY. JUNE 1, 1990 
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ESEA CHAPTER 1 AND DPPF 
ORIENTATION INSERVICE EVALUATION FORM 
1989-90 ORIENTATION 



A.M. P.M. 



Date of Orientation Meeting — 

Circle only the program(s) you are in: 

ESEA Chapter I Program*: BPPF Programs: 

#D (12) Secondary Reading (Regular) 

(2) CLEAR-Readlng Recovery (13) Secondary Reading (CAI) 

(3) CLEAR Non-Public (1-8) (14) HSCA 

(4) CLEAR-Priraary-Whole Language (2-3) 

(5) CLEAR -Elementary Regular (2-5) 

(6) CLEAR-Elementary-CAI (3-5) 
(?) CLEAR-Mlddle Regular (6-8) 

(8) CLEAR-Middle-CAI (6-8) 

(9) 'ftC-Eleoentary-CAI (3-5) 

(10) 'HC-Elementary-CBE (3-5) 

(11) MIC-Middle-CBE (6-7) Other (Specify) 



(15) 



Circle the number that indicates the extent to which you agree with statemencs i-4, in 
racing the overall day of tnservlce. 

Strongly Strongly 
Agree Agree Undecided Disagree Disagree 

1. I think this was a very worthwhile 

inservice. 5 4 3 2 1 

2. The information presented in this 
inservice will assist me in my 

program. 5 4 3 

3. There was time to ask questions 

pertaining to the presentations. 5 4 3 2 I 

4. Questions were answered adequately. 5 4 3 2 I 

Circle the number that indicates how you would rate each of the following portions of 
today's inservice In regard to Interest and usefulness of presentations. 

Superior Excellent Good Pair Poor 

5. Program Coordinators* Presentation 

a. Interest 5 4 3 2 1 

b. Usefulness 5 4 3 2 1 

c. Clarity of instructions 5 4 3 2 1 



************************************************ 

* * 

* Please turn over for questions 6-9 * 

* * 
************************************************ 
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Superior Excellent Good Fair Poor 

6. Evaluation Presentation 

a* Interest 5 4 3 2 1 

b. Usefulness 5 4 3 2 1 

c. Clarity of instructions 5 4 3 2 1 

7* What was the most valuable part of this meeting? 



8. What was the least valuable part of this meeting? 



9. What addition* information or topics would you like to see covered tn future 
meetings? 
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I riser vice Topic: 

Pres-snterCs): 

Date: / 



/ 



(e.g., 03/05/90) 



a.m. 



p.m. 



MM DD W 

Session (Check only one): all day 

Circle only the program(s) you are in: 

ESEA Chapter I Programs: 

(1) ADK 

(2) CLEAR-Readlng Recovery 

(3) CLEAR-Non-Public (1-8) \ 

(4) CLEAR-Whoie Language 

(5) CLEAR-Elementary-Regular (2-5) 

(6) CLEAR-Elementary-CAI (3-5) 

(7) CLEAR-Middie-Regular (6-8) 

(8) CLEAR-Mldd le-CAl (6-8) 

(9) MIC-E leoentary-CAI (3-5) 

(10) MIC-E lenient a ry-CBE (3-5) 

(11) MIC-Mlddle-CBE (6-7) 

Circle the number that Indicates the extent to which you agree or disagree with 
statements 1-4. 



DPPF Programs: 

(12) Secondary Reading Program 
(Regular) 

(13) Secondary Reading Program 
(CAI) 

(14) HSCA 

Other (Specify) 

(15) 



Strongly 
Agree 



1. I think this was a very worthwhile 
meeting* 

2. The Information presented In this 
meeting will assist me in my 
program. 

3. There was time to ask questions 
pertaining to the presentation. 

4. Questions were answered 
adequately. 



Strongly 

Agree Undecided Disagree Disagree 



I 



5 
5 



5. What was the most valuable part of this meeting? 



6. What was the least valuable part of this meeting? 



7. Please list any additional Information or topics you would Uke to see covered in 
future meetings, a) 



b) 
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Columbus Public Schools 
Department of Program Evaluation 
Process Evaluation 

COMPUTER CENSUS FORM 
FOR DPPF AND ESEA CHAPTER 1 PROGRAMS 
USING COMPUTER ASSISTED INSTRUCTION (CAI) 



Teacher 



School 



I. Please give the number of Computers 
or Terminals In your lab, by Type* 

Apple 

TRS-80 Color 

TRS-8C Black and "hite 

Tandy 1000-SL 

^JTandy-3000 

Tandy-4000, 
Other Tandy 

A cer 

Dolphin 

Sperry 

AT&T 

Atari 

Wicat 

PET 

Other 

Other 



Please check the company 
servicing the computers. 

Jostin 

Wasatch 
JCCC 
jtficat 

"Other 



Other 



3. Please check the type of lab 
you have* 

A pple lab 
ILA lab 

T andy lab 

Networked Tandy Lab 

Sperry Network System 

CCC Microhost lab 

Dolphin lab 
Wicat Systems lab 

Other 



4. Hoes your computer system Include a command module /teacher management 
system? Y es No 

5* Can the command module also be used as a pupil station? Yes — No -— NA 

6* How many computers (or terminals) are available in your lab for pupil 
work (do not include the Command Module)? 

7 m What Is the average number of minutes per week a pupil is served In the 
program? 



(Reading program pupils) (Math program pupils) 

8. What Is the average number of minutes per week a pupil work's at a computer? 



(Reading program pupils) 



(Math program pupils) 



9. Additional comments: 



DPE 2/90 
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Columbus Public Schools 
Department of Program Evaluation 
Process Evaluation 

EVALUATOR'S VISITATION LOG 
FOR DPPF-SRP AND ESEA CHAPTER 1 PROGRAMS 

1989-90 



CLEAR-Elem 
CLEAR -Mid 
SRP (Regular) 



CLEAR-E lem-C AI 

CLEAR-Mld-CAI 

SRP-CAI 



MIC-E lem-C AI 
MIC-Elem-CBE 
MIC-Mid-CBE 



School: 



Date: 



Time: from 



to 



Program Teacher: 



Eva luator: 



Grade(s) Observed: 



Number of Pupils In Class: 



General Directions: This Instrument consists of two sections, a Teacher's Rating Scale 
with space for optional comments and an Evaiuator's Observation Log. In addition a brief 
Interview will be conducted either before or after the observe Ion, whichever Is more 
convenient. The teacher should complete the Teacher's Rating Scale (Section A) prior to 
the evaiuator's visit and present the entire Instrument to the evaluator at the time of 
visitation. The evaluator will complete the Interview notes and Evaiuator's Observation 
Log (Section B) during the course of the visitation. 

SECTION A: TEACHER'S RATING SCALE AND INTERVIEW NOTES 

Directions: Please complete this section prior to the evaiuator's visit by rating the 
following aspects of your program. Circle the number In each Item that most closely 
corresponds to your rating of the Item on a scale where the highest rating Is 5 and the 
lowest rating 13 I (no fractions, please). Please respond to all rating scale Items In 
Section A. 

Pupil Progress 



1. The overall progress of this year's 
pupils 



Excellent 
5 4 



Very 
Poor 
2 1 



2. Share Progress of Pupils with Classroom 
and/or Content Area Teacher 



Very 
Frequent 

5 4 



Very 
Inf requent 

2 1 



Teacher's Optional Con meats 
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Parent Involvement 



3. Response to Efforts to Involve 



Very 
Responsive 

5 



Very 
Unresponsive 

2 t 



Change In Positive Pupil Behavior 
due to Parent Involvement 



Very 
Much 

5 4 



None 

2 1 



Frequency of Reporting Pupil Progress 
to Parents During a Quarter 



Teacher's Optional Comments 



(5) 10 or More Times 

(4) 7 to 9 Times 

(3) 4 to 6 Tlmea 

(2) t to 3 Tlmea 

(I) Less Than 1 Time 



Coordination with Classroom Teacher 



6. Cooperation of Classroom Teacher 



7. Effectiveness of Coordination 



Very 
Cooperative 
5 4 

Very 
Effective 
5 4 



Not at All 
Cooperative 



Not at All 
Effective 
2 i 



8. Frequency of Joint Planning During 
a Quarter 



Teacher's Optional Comments 



(5) 10 or More Times 
(4) 7 to 9 Times 
(3) 4 to 6 Times 
(2) I to 3 Times 
(1) Less Than 1 Time 
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Selection Process 

3. Selection Test Choice 

10. Problems 

11. Procedures 

12. Time Required 
Teacher's Optional Comments 



Class Scheduling 

13. Administrative Cooperation 

14. Teacher Cooperation 

15. Class Size 

Teacher's Optional Comments 



ERIC 



Excellent 
5 4 

None 

5 4 

Very 
Simple 

5 4 

Very 
Reasonable 

5 4 



Excellent 
5 4 



5 
5 



4 
4 



Testing; Achievement Measure (CTBS) 

16. Choice of Test 

17. Problems 

18. Procedures 

19. Test Scheduling 

20. Time Required 

Teacher's Optional Comments 



Excellent 
5 4 

None 

5 4 

Very 
Simple 

5 4 

Very 
Easy 

5 4 

Very 
Reasonable 

5 4 



^9 



3 
3 



3 
3 
3 



3 



Very 
Poor 

2 1 

Many 

2 I 

Very 
Complex 

2 1 

Very 
Unreasonable 

*> I 



2 
2 
2 



Very 
Poor 
I 

1 

1 



Very 
Poor 

2 1 

Many 

2 1 

Very 
Complex 
2 I 

Very 
Difficult 

2 1 

Very 
Unreasonable 

2 1 



PVAL3RVCS /P514 /RPTFMIC90 



Evaluation Feedback 



21. Quantity 



22. Information 



23. Time Factor 
Teacher's Optional Comments 



Materials Provided for Program 



24 . Amount 



25. Levels 



26. Condition 
Teacher's Optional Comments 



Facilities 

27. Space 

28. Light 

29. Temperature/Ventilation 

30. Noise Level 

31. Furniture 

32. Storage 

Teacher's Optional Comments 



Very 
Adequate 

5 4 

Very 
Useful 

5 4 

Very 
Timely 

5 4 



Very 
Adequate 

5 4 

Very 
Appropriate 
5 4 

New 

5 4 



Excellent 
5 4 



5 
5 
5 
5 
5 



4 
4 
4 
4 
4 



3 
3 
3 
3 
3 
3 
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Very 
Inadequate 

2 1 



Of No Use 

2 1 

Very 
Untimely 

2 i 



Very 
Inadequate 

2 1 

Very 
Inappropriate 

2 i 

Old 

2 I 



Very 
Poor 



2 
2 
2 
2 

2 

-> 
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Columbus Public Schools 
Department of Program Evaluation 
Process Evaluation 

EVALUATOR'S VISITATION LOG 
FOR DPPF-SRP AND ESEA CHAPTER 1 PROGRAMS 

1989-90 

SECTION B: EVALUATOR'S OBSERVATION LOG (MIC) 
Directions for Evaluator: Check ( X ) ail pupil activities observed during Che visit. 
Activities In Lab 

1. Working with Calculators 

2. Reviewing Prior Knowledge with Teacher and Filling in Background Needed 
for Lesson with Teacher Guidance 

3. Working Matn Pussies 

4. Working on Drill and Practice Exercises 

5. Solving Story Problems 

6. Using Manipulatives to Bettter Understand a Math Concept 

7. Reviewing and Strengthening Specific Skills and/or Concepts 

8. Working at Learning Centers 

9. Watching Demonstrations or Doing Experiments 

10. Doing Computer Activities 

11. Participating in a Small Group Discussion 

12. Working Problems at the Chalk Board 
13. 'J sing Play Money 

14. Participating in Timed Skill Drill Marathon 

15. Test Taking 

16. Other 
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Columbus Public Schools 
Department of Program Evaluation 
Process Evaluation 

EVALUATOR'S VISITATION LOG 
FOR OPPF-SRP AND ESEA CHAPTER I PROGRAMS 

1989-90 

SECTION C: EVALUATOR'S ADDITIONAL INTERVIEW ITEMS 



Evaluator's Directions: The evaluator should concentrate on the following areas In the 
course of, the Interview. 

Rating Scale with Teacher's Optional Comments 

Look over the Rating Scale previously completed by the teacher and inquire about any 
areas that seem to require further clarification. 



Selection Procedures 



Yes 



No 



NA 



I. Program guidelines for selecting pupils 
are followed. 



Recori Keeping 



Yes 



No 



NA 



2. Pupil personal data and attendance 
are recorded on DFSP Student Data 
Sheets or alternative form/method. 



3. Teacher understands procedures for 
recording attendance and enrollment 
on DFSP Student Data Sheet (Including 
special guidelines for CLE AR-E I em-C AI 
and the MIC programs). 



4. Correct procedures are followed In 
completing PCFs. 
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Record Keeping (Cont'd) 

Yes No NA 



5. Add Forms 

a. Are Add Forms up-to-date? 
b* Are more Add Forms needed? 



Coordtnatton with Classroom Teachers 

6* What primary method(s) do you use for coordination 
with classroom and/or subject area teachers? 
Check all that apply* 

Scheduled Meetings 

Written Communication 

Informal Contact 

Information from Pupils 

Other 



Contact with the Home 

7. What primary method(s) do you use for reporting 
to parents? Check ail that apply* 

Parent Conferences (School or Home Visits) 

T elephone Calls 
Written Notes 

Progress Reports (e.g* checklists* computer 

generated reports* etc*) 
Grade Cards 

N ewsletters 

P arental Supervised Homework 

Other 
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Monitoring of Pupil Progress 

8* What primary method(s) do you use to -aonitor 
pupil progress? Check all that apply. 

Individual Work Folders 

C onferences vith Pupils 

Checklists 

Graphs and/or Charts 

A ssignment Sheets 

Tests and/or Quizzes 

Computer Management System 

C halkboard Exercises 

Oral Activities 

Homework Assignments 

Other 
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Appendix B 
Additional Tables 
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Table *~\ 

Minimum, Maximum, Median, and Standard Deviation of the 
Pretest and Post teat Percentiles for MtC-CAi Program 
In Total Mathematics Reported by Grade Level 

1989-90 



Pretest Posttest 

Number Median Standard Median Standard 

Grade of Pupils Min. Max. Percentile Deviation Min. Max. Percentile Deviation 



3 140 1.0 79.0 16.0 15.6 1.0 96.0 37.5 24.9 

4 220 1.0 87.0 17.0 11.2 i .0 94.0 27.0 18.1 

5 162 1.0 66.0 23.0 10.6 2.0 93.0 33.0 19.9 



Total 522 1.0 87.0 19.0 12.5 1.0 96.0 31.0 21.2 
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Table B-2 

Minimum, Maximum, Median, a.id Standard Deviation ot the 
Pretest and Post test Percentiles for MIC-CAI Program 
In Mathematics Concepts and Applications Reported by Grade Level 

1989-90 











Pretest 








Posttest 






Number 






Median 


Standard 






Median 


Standard 


Grade 


of Pupils 


Mln. 


Max. 


Percentile 


Deviation 


Mln. 


Max* 


Percentile 


Deviation 


3 


139 


1.0 


75.0 


13.0 


15.8 


1 .0 


97.0 


32.0 


20.6 


4 


220 


1.0 


89.0 


23.0 


14.0 


1.0 


90.0 


27.0 


18.2 


5 


158 


1.0 


85.0 


28.0 


14.1 


2.0 


89.0 


25.0 


18.7 


Total 


517 


t.n 


89.0 


21 .0 


15.0 


t -0 


97.0 


28.0 


19.2 
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Table 3-3 



Minimum, Maximum, Median, and Standard Deviation of the 
Pretest and Posttest Percentiles for MTC-CBE Program 
in Total Mathematics Reported by Grade Level 

1989-90 











Pretest 








Posttest 




Grade 


Number 
of Pupils 


Mln. 


Max. 


Median 
Percentile 


Standard 
Deviation 


Mln. 


Max. 


Median 
Percentile 


Standard 
Deviation 


3 


81 


1.0 


66.0 


15.0 


14.9 


2.0 


92.0 


45.0 


22.1 


4 


101 


1.0 


66.0 


18.0 


12.1 


2.0 


89.0 


29.0 


17.7 


5 


85 


2.0 


80.0 


24.0 


13.5 


1.0 


91.0 


39.0 


23.8 


6 


170 


1.0 


74.0 


20.0 


11.7 


1.0 


86.0 


30.0 


22.3 


7 


130 


1.0 


45.0 


16.0 


9.0 


1.0 


98.0 


33.5 


19.3 


8 


18 


13.0 


31.0 


21.5 


5.5 


19.0 


42.0 


28.5 


6.5 


Total 


585 


1.0 


80.0 


19.0 


12.1 


1 .0 


98.0 


34.0 


21.3 
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Table p-4 

Minimum, Maximum, Median, and Standard Deviation of the 
Pretest and Posttest Percentiles for MIC-CBE Program 
in Mathematics Concepts and Applications Reported by Grade Level 

1989-90 



Pretest Posttest 

Number Median Standard Median Standard 

Grade of Pupils Min. Max. Percentile Deviation Mtn. Max* Percentile Deviation 



3 


82 


1.0 


99.0 


15.5 


17.2 


1.0 


93.0 


40.0 


22.0 


4 


103 


1.0 


69.0 


25.0 


14.3 


1.0 


90.0 


27.0 


17.8 


5 


81 


9.0 


85.0 


31.0 


12.6 


2.0 


92.0 


37.0 


22.0 


6 


170 


2.0 


78.0 


16.0 


14.5 


1.0 


81.0 


27.0 


19.3 


7 


130 


1.0 


57.0 


15.0 


11.5 


1.0 


97.0 


36.5 


20.2 


8 


18 


8.0 


41.0 


18.5 


9.6 


9.0 


50.0 


26.0 


10.0 



Total 584 1.0 99.0 19.0 14.4 1.0 97.0 30.0 20.4 
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